Search assistant returning empty message with DISABLE_LITELLM_STREAMING enabled

[marcelogdeandrade]

Hello,

TL;DR: Search assistant is not working properly with DISABLE_LITELLM_STREAMING config enabled.

I'm trying to use Onyx with DISABLE_LITELLM_STREAMING config enabled, since my custom model server doesn't support streaming yet. Although it is working normally for General assistant, the Search one is returning empty messages.

I've tested this behavior with both a custom model server and an OpenAI direct connection config, both of them have the same empty result.

If I disable DISABLE_LITELLM_STREAMING, the Search assistant work as expected.

Steps to reproduce:

• Enable DISABLE_LITELLM_STREAMING through .env file when deploying Onyx with docker-compose
• Config LLM with OpenAI Model
• Try to use Search assistant

[github-actions]

This issue is stale because it has been open 75 days with no activity. Remove stale label or comment or this will be closed in 15 days.

[github-actions]

This issue was closed because it has been stalled for 90 days with no activity.