OpenAI, Google and Anthropic Batch API support #528
Description
Hi,
Can you please add Batch API support for OpenAI, Google and Anthropic? Batching saves 50% and is commonly used for large deployments, it is a key feature.
{{ message }}
Hi,
Can you please add Batch API support for OpenAI, Google and Anthropic? Batching saves 50% and is commonly used for large deployments, it is a key feature.