Skip to content

Pull requests: vllm-project/vllm

New pull request New
593 Open 7,637 Closed
593 Open 7,637 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[V1][Spec Decode] Always use argmax for sampling draft tokens v1
#16899 opened Apr 21, 2025 by WoosukKwon • Draft
1
Inluce extra module from sentence transformer
#16898 opened Apr 21, 2025 by yupbank Loading…
1
1
[Bugfix] Fix v1/spec_decode/test_ngram.py v1
#16895 opened Apr 20, 2025 by zixi-qi Loading…
1
house keeping - fixing docker build warning ci/build
#16893 opened Apr 20, 2025 by wyattearp Loading…
1
profiling to find bottleneck of runing vllm --version frontend
#16891 opened Apr 20, 2025 by davidxia • Draft
2
Added support for HermesToolParser for models without special tokens frontend
#16890 opened Apr 20, 2025 by minpeter Loading…
1
Restore buffers when wake up from level 2 sleep (#16564) v1
#16889 opened Apr 20, 2025 by fingertap Loading…
1
1
[doc] install required python3-dev apt package documentation Improvements or additions to documentation
#16888 opened Apr 20, 2025 by davidxia Loading…
1
[frontend] enhance tool_calls type check frontend
#16882 opened Apr 20, 2025 by reidliu41 Loading…
1
1
[Perf] Optimize MRotaryEmbedding::get_input_positions performance by numba v1
#16881 opened Apr 19, 2025 by imkero • Draft
1
[Bugfix] Fix Qwen2.5-Omni M-RoPE position ids generation
#16878 opened Apr 19, 2025 by imkero Loading…
2
[TPU][V1] Implicitly adjust page size when there's SMEM OOM ready ONLY add when PR is ready to merge/full CI is needed tpu Related to Google TPUs v1
#16871 opened Apr 19, 2025 by yaochengji Loading…
1
Add pt_load_map_location to allow loading to cuda
#16869 opened Apr 19, 2025 by jerryzh168 Loading…
2
Support loading transformers models with named parameters
#16868 opened Apr 18, 2025 by wuisawesome Loading…
4
[WIP][Attention] FA3 decode perf improvement - single mma warp group support for head dim 128 ci/build v1
#16864 opened Apr 18, 2025 by LucasWilkinson • Draft
1
[Bugfix]: fix issue with n>1 sampling on v1 requests overriding each other bug Something isn't working v1
#16863 opened Apr 18, 2025 by jeffrey-dot-li Loading…
1
7
[V1] vLLM OpenAI API custom args frontend
#16862 opened Apr 18, 2025 by afeldman-nm • Draft
1
3
[Kernel] Add expert_map support to Cutlass FP8 MOE
#16861 opened Apr 18, 2025 by varun-sundar-rabindranath Loading…
4
[TESTING] Update PyTorch to 2.7.0 ci/build
#16859 opened Apr 18, 2025 by huydhn Loading…
2
Add default local directory LoRA resolver plugin. documentation Improvements or additions to documentation
#16855 opened Apr 18, 2025 by jberkhahn Loading…
1
1
[Bugfix] Fix moe weight losing all extra attrs after process_weights_after_loading.
#16854 opened Apr 18, 2025 by charlifu Loading…
1
[Model][Frontend] Adding timeseries modality support and Qwen2.5-ChatTS model support frontend multi-modality Related to multi-modality (#4194)
#16852 opened Apr 18, 2025 by chemeris Loading…
19
[Kernel] some optimizations for dense marlin and moe marlin ci/build
#16850 opened Apr 18, 2025 by jinzhen-lin Loading…
4
[CORE] Eliminate Occasional Scheduling Delay for Parallel Sampling v1
#16849 opened Apr 18, 2025 by dblincoe • Draft
2
[V1] Async DP shutdown test v1
#16846 opened Apr 18, 2025 by afeldman-nm • Draft
1
ProTip! Filter pull requests by the default branch with base:main.