Skip to content

add uri_base support to Regent::LLM::OpenAI#2

Merged
alchaplinsky merged 1 commit intofwdai:mainfrom
codegestalt:openai-api-support
Apr 3, 2025
Merged

add uri_base support to Regent::LLM::OpenAI#2
alchaplinsky merged 1 commit intofwdai:mainfrom
codegestalt:openai-api-support

Conversation

@danielpuglisi
Copy link
Contributor

@danielpuglisi danielpuglisi commented Mar 25, 2025

This makes it possible to use OpenAI compatible APIs like Groq, Deepseek and also works with Ollama through the ruby-openai gem: https://github.com/alexrudall/ruby-openai?tab=readme-ov-file#azure

Regent::LLM::OpenAI.new(
  model: 'qwen-qwq-32b',
  api_key: 'groq_api_key',
  uri_base: 'https://api.groq.com/openai'
)

@alchaplinsky alchaplinsky merged commit d5a59ce into fwdai:main Apr 3, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants