v1.67.5-nightly

What's Changed

• [Docs] v1.67.4-stable by @ishaan-jaff in #10338
• Prisma Migrate - support setting custom migration dir by @krrishdholakia in #10336
• Fix: Prevent cache token overwrite by last chunk in streaming usage by @mdonaj in #10284
• [UI] Fixes for sessions on UI - ensure errors have a session and use 1 session for test key by @ishaan-jaff in #10342
• [UI QA Bug Fix] - Fix SSO Sign in flow by @ishaan-jaff in #10344
• [UI] Fix infinite Scroll on Models on Test Key Page by @ishaan-jaff in #10343
• [UI QA Fix] Fix width of the model_id on Models Page by @ishaan-jaff in #10345
• Fix - support azure dall e custom pricing by @krrishdholakia in #10339
• [Bug Fix] UI QA - Fix wildcard model test connection not working by @ishaan-jaff in #10347
• Litellm UI improvements 04 26 2025 p1 by @krrishdholakia in #10346
• [QA] Allow managing sessions with litellm_session_id by @ishaan-jaff in #10348
• Handle more gemini tool calling edge cases + support bedrock 'stable-image-core' by @krrishdholakia in #10351
• [Feat] Add logging callback support for /moderations API by @ishaan-jaff in #10390
• [Reliability fix] Redis transaction buffer - ensure all redis queues are periodically flushed by @ishaan-jaff in #10393
• [Bug Fix] Responses API - fix for handling multiturn responses API sessions by @ishaan-jaff in #10415
• build(deps): bump axios, @docusaurus/core, @docusaurus/plugin-google-gtag, @docusaurus/plugin-ideal-image and @docusaurus/preset-classic in /docs/my-website by @dependabot in #10419
• docs: Fix link formatting in GitHub PR template by @user202729 in #10417
• docs: Improve documentation of phoenix logging by @user202729 in #10416
• [Feat Security] - Allow blocking web crawlers by @ishaan-jaff in #10420
• [Feat] Add support for using Bedrock Knowledge Bases with LiteLLM /chat/completions requests by @ishaan-jaff in #10413
• Revert "build(deps): bump axios, @docusaurus/core, @docusaurus/plugin-google-gtag, @docusaurus/plugin-ideal-image and @docusaurus/preset-classic in /docs/my-website" by @ishaan-jaff in #10421
• fix google studio url by @nonZero in #10095
• [New model] Add openai/computer-use-preview cost tracking / pricing by @ishaan-jaff in #10422
• fix(langsmith.py): respect langsmith batch size param by @krrishdholakia in #10411
• Support x-litellm-api-key header param + allow key at max budget to call non-llm api endpoints by @krrishdholakia in #10392

New Contributors

• @mdonaj made their first contribution in #10284
• @user202729 made their first contribution in #10417
• @nonZero made their first contribution in #10095

Full Changelog: v1.67.4-nightly...v1.67.5-nightly

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.67.5-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	270.0	290.6566157251101	6.175800923917475	0.0	1848	0	232.84122400002616	2432.3238870000523
Aggregated	Passed ✅	270.0	290.6566157251101	6.175800923917475	0.0	1848	0	232.84122400002616	2432.3238870000523