Skip to content

Conversation

@danielpuglisi
Copy link
Contributor

@danielpuglisi danielpuglisi commented Mar 25, 2025

This makes it possible to use OpenAI compatible APIs like Groq, Deepseek and also works with Ollama through the ruby-openai gem: https://github.com/alexrudall/ruby-openai?tab=readme-ov-file#azure

Regent::LLM::OpenAI.new(
  model: 'qwen-qwq-32b',
  api_key: 'groq_api_key',
  uri_base: 'https://api.groq.com/openai'
)

@alchaplinsky alchaplinsky merged commit d5a59ce into alchaplinsky:main Apr 3, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants