We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
主要考虑本地并发和延迟,大佬的全流式已经给延迟降的很低了,感谢。 但是本地部署的并发数是很大的问题,vllm+mqtt+opus应该能有效提高并发。能不能加入这些代码?
The text was updated successfully, but these errors were encountered:
目前还没想好怎么搞,如果可以,有空提供思路或者一起加入开发
Sorry, something went wrong.
目前websocket,与其他逻辑处理耦合严重,如想无缝切换mqtt则需要将中间处理逻辑与websocket解耦,每个逻辑的功能单一,明确统一入参和返回值
No branches or pull requests
主要考虑本地并发和延迟,大佬的全流式已经给延迟降的很低了,感谢。
但是本地部署的并发数是很大的问题,vllm+mqtt+opus应该能有效提高并发。能不能加入这些代码?
The text was updated successfully, but these errors were encountered: