Skip to content

Pull requests: vllm-project/vllm

New pull request New
697 Open 9,032 Closed
697 Open 9,032 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Fix] Remove unused opentelemetry-semantic-conventions-ai dependency ci/build documentation Improvements or additions to documentation
#19313 opened Jun 7, 2025 by conroy-cheers Loading…
3
[Bugfix][V1] Fix memory profile to allow multiple servers to start on the same card v1
#19312 opened Jun 7, 2025 by yeqcharlotte Loading…
3
[Nit][Benchmark]Fix example in benchmark_serving_structured_output.py ready ONLY add when PR is ready to merge/full CI is needed structured-output
#19311 opened Jun 7, 2025 by draftbk Loading…
5
[Misc]: refactor: ParallelConfig init func
#19310 opened Jun 7, 2025 by googs1025 Loading…
3 tasks
5
Update compatible packaging version ci/build ready ONLY add when PR is ready to merge/full CI is needed
#19309 opened Jun 7, 2025 by pramenku Loading…
4
[doc] improve ci doc ci/build documentation Improvements or additions to documentation
#19307 opened Jun 7, 2025 by reidliu41 Loading…
3 tasks
5
Use xla flag to improve the quantized model performance ready ONLY add when PR is ready to merge/full CI is needed tpu Related to Google TPUs v1
#19303 opened Jun 6, 2025 by vanbasten23 Loading…
3 tasks done
4
[Misc] Change tests/compile to use VLLM_V1 by default ready ONLY add when PR is ready to merge/full CI is needed
#19302 opened Jun 6, 2025 by zou3519 Loading…
4
Add optional token-level progress bar to LLM.beam_search using tqdm frontend
#19301 opened Jun 6, 2025 by NekoMimiUnagi Loading…
3 tasks done
5
[Bugfix] Re-enable use_cudagraph in vLLM v1 ready ONLY add when PR is ready to merge/full CI is needed
#19299 opened Jun 6, 2025 by zou3519 Loading…
7
[Misc] Fixes and Optimizations for DeepEP + DeepGEMM combination. ready ONLY add when PR is ready to merge/full CI is needed v1
#19298 opened Jun 6, 2025 by varun-sundar-rabindranath Loading…
11
[CI] Update FlashInfer to 0.2.6 ci/build
#19297 opened Jun 6, 2025 by mgoin Loading…
7
[Quantization] Bump compressed-tensors version ci/build ready ONLY add when PR is ready to merge/full CI is needed
#19295 opened Jun 6, 2025 by kylesayrs Loading…
4
[V1] Add API docs for EncoderCacheManager ready ONLY add when PR is ready to merge/full CI is needed v1
#19294 opened Jun 6, 2025 by russellb Loading…
4
[TPU] support fp8 kv cache quantization tpu Related to Google TPUs v1
#19292 opened Jun 6, 2025 by yaochengji Loading…
7
[Metrics] Compute and log the serving FLOPs documentation Improvements or additions to documentation
#19290 opened Jun 6, 2025 by sysradium Loading…
1
13
[Misc] Add documentation update reminder to PR template ci/build
#19289 opened Jun 6, 2025 by Isotr0py Loading…
1 of 3 tasks
3
[Frontend] Remove unreachable code from llm.py frontend
#19288 opened Jun 6, 2025 by KsuParkhamchuk Loading…
4
[CI/Build] Improve Llama GGUF test robustness ready ONLY add when PR is ready to merge/full CI is needed
#19287 opened Jun 6, 2025 by Isotr0py Loading…
1 of 3 tasks
4
[Core] Update error message for Whisper + num-scheduler-steps > 1 ready ONLY add when PR is ready to merge/full CI is needed
#19286 opened Jun 6, 2025 by russellb Loading…
3
[Bugfix]: Fix TypeError: 'float' object cannot be interpreted as an integer ready ONLY add when PR is ready to merge/full CI is needed v1
#19283 opened Jun 6, 2025 by chaunceyjiang Loading…
1
7
[V1][Kernel] Flashinfer HND KV cache layout v1
#19280 opened Jun 6, 2025 by NickLucche Loading…
7
[Frontend] optimize beam_search code
#19267 opened Jun 6, 2025 by zhanggzh Loading…
5
Fix TorchAOConfig skip layers
#19265 opened Jun 6, 2025 by mobicham Loading…
9
Convert kv_transfer_config from dict to KVTransferConfig to fix #19259 frontend
#19262 opened Jun 6, 2025 by maobaolong Loading…
1
4
ProTip! Exclude everything labeled bug with -label:bug.