Search results

Feature request: Update numpy dependency to allow >=2.0

non-staleThis label can be used to prevent marking issues or PRs as StaleThis label can be used to prevent marking issues or PRs as Stale

Status: Open.

#93 In triton-inference-server/pytriton;

· dmatlak opened on Jan 22, 2025

[Question] Tensor parallelism for tensorrt_llm

non-staleThis label can be used to prevent marking issues or PRs as StaleThis label can be used to prevent marking issues or PRs as Stale

Status: Open.

#79 In triton-inference-server/pytriton;

· JoeLiu996 opened on Jul 5, 2024

Example of TensorRT-LLM Whisper backend for PyTriton

enhancementNew feature or requestNew feature or request

non-staleThis label can be used to prevent marking issues or PRs as StaleThis label can be used to prevent marking issues or PRs as Stale

Status: Open.

#65 In triton-inference-server/pytriton;

· aleksandr-smechov opened on Mar 20, 2024

Put <code>pytriton.client</code> in the separate package/wheel.

enhancementNew feature or requestNew feature or request

non-staleThis label can be used to prevent marking issues or PRs as StaleThis label can be used to prevent marking issues or PRs as Stale

Status: Open.

#62 In triton-inference-server/pytriton;

· flyingleafe opened on Feb 5, 2024

pytriton use onnx is slower than onnx runtime for tiny bert model

bugSomething isn't workingSomething isn't working

non-staleThis label can be used to prevent marking issues or PRs as StaleThis label can be used to prevent marking issues or PRs as Stale

Status: Open.

#61 In triton-inference-server/pytriton;

· yan123456jie opened on Jan 26, 2024

How to infer with sequence ?

enhancementNew feature or requestNew feature or request

non-staleThis label can be used to prevent marking issues or PRs as StaleThis label can be used to prevent marking issues or PRs as Stale

questionFurther information is requestedFurther information is requested

Status: Open.

#50 In triton-inference-server/pytriton;

· monsterlyg opened on Dec 27, 2023

Support Mac installation

enhancementNew feature or requestNew feature or request

non-staleThis label can be used to prevent marking issues or PRs as StaleThis label can be used to prevent marking issues or PRs as Stale

Status: Open.

#44 In triton-inference-server/pytriton;

· zbloss opened on Nov 21, 2023

How to pass priority level during inference?

enhancementNew feature or requestNew feature or request

non-staleThis label can be used to prevent marking issues or PRs as StaleThis label can be used to prevent marking issues or PRs as Stale

Status: Open.

#42 In triton-inference-server/pytriton;

· jackielam918 opened on Nov 16, 2023