[FR] Swappable LLM Drivers

[HelgeSverre]

Similarly to what I've previously done with Brain, add support for implementing swappable and extendable Drivers for the underlying LLM API so we can use this package along with other providers that are cheaper/faster than OpenAI.

Providers

• Together.ai
• Fireworks.ao
• Groq
• Antrophic
• Ollama (via rest API)

Clone the driver-based approached used in chatflow (private repo), should not be crazy hard to do.

[Jens-dev]

Thanks for your hard work!
If you could also integrate a way to change the OpenAI URL would be awesome, or a dedicated AzureOpenAi Provider.
Working in Europe, we can not use the standard OpenAI, thanks to the GDPR and the Data Residency problem.
We had the idea to switch to the M$ Azure OpenAI Plan.
Would that be possible?