Open
Description
vLLM provides an HTTP API compatible to OpenAI.
We want to support talking to it, as an additional LLM API type.
Please also update the docs.
The task is similar to #627.
❤️ Contributors, please refer to 📙Contributing Guide.
Unless the PR can be sent immediately (e.g. just a few lines of code), we recommend you to leave a comment on the issue like I'm working on it or Can I work on this issue? to avoid duplicating work. Our Discord server is always open and friendly.