-
Notifications
You must be signed in to change notification settings - Fork 22
Open
Labels
Description
Is your feature request related to a problem? Please describe.
The current implementation supports only Azure OpenAI as the LLM provider. It lacks the flexibility to support other LLM providers such as OpenAI directly, Anthropic, Google or Groq. This would open opportunities for easy future migration to more efficient provider.
Describe the solution you'd like
- Update the
.env
configuration file to support specifying alternative LLM providers. - Modify the backend in
main.py
to read and initialize the appropriate LLM client based on the selected provider from the.env
file. - Implement helper functions to set up clients for the new LLM providers.
Additional context
- Update
.env
to include environment variables for configuring alternative LLM providers. - Thoroughly test switching between different LLM providers to ensure smooth initialization and operation.