LLM Service Provider Integrations Poll

[missBerg]

There are many LLM Providers out there, so which are the ones you are most interested in getting easy Envoy AI Gateway integration with?

As of 0.1, we have OpenAI & AWS Bedrock.

Integration means that we have Upstream Auth Integration and unified API integration.

If you selecting other please leave a comment :)

[rootfs]

Would love to see Llama Stack integration too

[zhyg]

Hope to integrate openrouter

[shmuelk]

Add WatsonX.AI

[teaglebuilt]

Yeah I was about to create a pull request but I see we already have an integration example for a traditional backend. I think this would work for an ollama integration? I was brainstorming of building a bridge for openwebui to use aigateway

[mathetake]

I believe at this point, each "desired" provider should have its own issue and tracked in the doc here: https://aigateway.envoyproxy.io/docs/latest/supported-providers/