Skip to content

Add Option to Specify Other LLM Providers in .env #10

@nibzard

Description

@nibzard

Is your feature request related to a problem? Please describe.
The current implementation supports only Azure OpenAI as the LLM provider. It lacks the flexibility to support other LLM providers such as OpenAI directly, Anthropic, Google or Groq. This would open opportunities for easy future migration to more efficient provider.

Describe the solution you'd like

  1. Update the .env configuration file to support specifying alternative LLM providers.
  2. Modify the backend in main.py to read and initialize the appropriate LLM client based on the selected provider from the .env file.
  3. Implement helper functions to set up clients for the new LLM providers.

Additional context

  • Update .env to include environment variables for configuring alternative LLM providers.
  • Thoroughly test switching between different LLM providers to ensure smooth initialization and operation.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions