Search results

v0.5.0 Roadmap

Status: Open.

#1396 In vllm-project/aibrix;

· Jeffwan opened on Aug 5, 2025

Update v0.4.0 doc, examples, blog post and benchmark

kind/documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#1376 In vllm-project/aibrix;

· Jeffwan opened on Aug 1, 2025

· 

v0.4.0

Update P/D model deployment and routing guidance in documentation

area/disaggregated

kind/documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#1375 In vllm-project/aibrix;

· Jeffwan opened on Aug 1, 2025

· 

v0.4.0

Sglang router error: failed to select worker pair

area/disaggregated

Status: Open.

#1351 In vllm-project/aibrix;

· nwangfw opened on Jul 30, 2025

Qwen8 stormservice deployment error nixl._bindings.nixlBackendError: NIXL_ERR_BACKEND

triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.

Status: Open.

#1347 In vllm-project/aibrix;

· nwangfw opened on Jul 29, 2025

storm service failed to detect other roles

Status: Open.

#1345 In vllm-project/aibrix;

· Jeffwan opened on Jul 29, 2025

streaming mode doesn't work for in-house engine

area/gateway

area/inference-engine

Status: Open.

#1340 In vllm-project/aibrix;

· Jeffwan opened on Jul 28, 2025

Support HTTPRoute for StormService

area/gateway

priority/critical-urgentHighest priority. Must be actively worked on as someone's top priority right now.Highest priority. Must be actively worked on as someone's top priority right now.

Status: Open.

#1321 In vllm-project/aibrix;

· Jeffwan opened on Jul 25, 2025

Does it support speculative decoding with a draft model that is not an ngram?

Status: Open.

#1320 In vllm-project/aibrix;

· libin817927 opened on Jul 25, 2025

Support role upgrade sequences in stormservice

area/orchestration

kind/featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

Status: Open.

#1292 In vllm-project/aibrix;

· Jeffwan opened on Jul 15, 2025

Support Pauseable Upgrades in Storm Service

area/orchestration

help wantedExtra attention is neededExtra attention is needed

kind/featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

priority/important-longtermImportant over the long term, but may not be staffed and/or may need multiple releases to complete.Important over the long term, but may not be staffed and/or may need multiple releases to complete.

Status: Open.

#1291 In vllm-project/aibrix;

· Jeffwan opened on Jul 15, 2025

Support prefill and decode colocate on same host

area/orchestration

kind/featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

priority/critical-urgentHighest priority. Must be actively worked on as someone's top priority right now.Highest priority. Must be actively worked on as someone's top priority right now.

Status: Open.

#1290 In vllm-project/aibrix;

· Jeffwan opened on Jul 15, 2025