Replies: 1 comment 1 reply
-
|
Partially, you can send multiple parallel requests, they will be queued up and executed in order. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
ah - that's what I would call sequential then ;) |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Wondering if it can do parallel queries like vllm? If so how?
Beta Was this translation helpful? Give feedback.
All reactions