Feature Request: Add support for additional LLM providers

[0scvr]

Describe the feature

Add support for additional LLM providers such as Anthropic (Claude) and Google (Gemini) alongside existing OpenAI integration.

Why is this feature important?

Supporting multiple LLM providers offers flexibility, reduces vendor lock-in, and allows users to choose the best model for their specific use case. It also ensures continued service availability and takes advantage of the unique capabilities of each provider.

Additional context, screenshots, and relevant links

No response

[zachgoll]

The codebase is fully compatible with this! We're just intentionally delaying this for some time while we work through the initial bugs and feature requests surrounding the overall chat feature.

Stability first, then we'll expand to a variety of models!