Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add instance pool for api_v3.py #1136

Open
wants to merge 9 commits into
base: fast_inference_
Choose a base branch
from

Conversation

KevinZhang19870314
Copy link

@KevinZhang19870314 KevinZhang19870314 commented May 27, 2024

  1. 按照你在1092提出的实现修改了一版;
  2. 添加了save_configs参数到init_vits_weightsinit_t2s_weightsset_device中,防止在“复用已有实例”逻辑中覆盖了配置文件;
  3. 同时发现了一个问题,在fastapi界面调用api一次,从log中看到执行了2次,如果点击播放按钮还会在执行一次,下面是调用一次api之后的log,不明白为什么。。。
    logs.txt

麻烦有空拉下代码看一下。@ChasonJiang

EDIT: 问题3可能是浏览器流式输出的问题,可忽略。 使用python requests调用正常。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant