New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

为什么说“当前Inference场景中，无论用户直接使用TFServing还是使用TF提供的C++接口调用Session::Run，都无法实现多个Session并发处理Request” #1009

Open

Nov11 opened this issue Sep 25, 2024 · 0 comments

Nov11 commented Sep 25, 2024 •

edited

Loading

The DeepRec docs are open source! To get involved, read the user documents: https://deeprec.readthedocs.io/en/latest/index.html

URL(s) with the issue

Description of issue (what needs changing)

如题, 文档里看到这句话, 是指Session::Run内部有锁之类的操作, 使得统一时刻发出的多个Session::Run调用必须排队吗?

求指明什么地方有这种限制,看了半天tf代码没发现不对劲的地方🤦

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment