Skip to content

[Feature] 为了提高响应和并发,能不能添加mqtt协议和opus音频传输 #1445

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
youisan opened this issue Jun 2, 2025 · 2 comments
Labels
enhancement New feature or request

Comments

@youisan
Copy link

youisan commented Jun 2, 2025

主要考虑本地并发和延迟,大佬的全流式已经给延迟降的很低了,感谢。
但是本地部署的并发数是很大的问题,vllm+mqtt+opus应该能有效提高并发。能不能加入这些代码?

@youisan youisan added the enhancement New feature or request label Jun 2, 2025
@openrz
Copy link
Collaborator

openrz commented Jun 2, 2025

目前还没想好怎么搞,如果可以,有空提供思路或者一起加入开发

@myifeng
Copy link
Contributor

myifeng commented Jun 4, 2025

目前websocket,与其他逻辑处理耦合严重,如想无缝切换mqtt则需要将中间处理逻辑与websocket解耦,每个逻辑的功能单一,明确统一入参和返回值

  1. 代码结构分层,分离websocket对象,websocket对象仅在开头接受message和发送message使用
  2. 使用工厂或者接口,定义message的处理器,由不同的子类进行处理不同type的message,并定义统一的返回结构
  3. 根据返回的结构,执行语音转文字
  4. 根据返回的结构,将message通过websocket/mqtt发送

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants