Skip to content

Pull requests: llm-d/llm-d-kv-cache

New pull request New
26 Open 123 Closed
26 Open 123 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Refactor: Replace transformers with vLLM
#234 opened Dec 27, 2025 by hyeongyun0916 Loading…
25
[Hold]Fix Example kv_cache_index pod listing returns empty
#229 opened Dec 23, 2025 by yankay Loading…
1
7
Async tokenize exec
#225 opened Dec 22, 2025 by alpe Loading…
2
Optimize uds tokenizer performance using grpc & thread pool
#222 opened Dec 19, 2025 by delavet Loading…
1
Refactor: Replace daulet/tokenizers with vLLM
#221 opened Dec 18, 2025 by hyeongyun0916 Loading…
34
feat: Support multi modal chat completion requests
#219 opened Dec 16, 2025 by sagearc Loading…
14
PVC Evictor
#215 opened Dec 15, 2025 by guygir Loading…
2
Automatic vLLM pod discovery + ZMQ subscription mgmt for KVEvents
#212 opened Dec 14, 2025 by vMaroon Loading…
1
16
tokenization: pool should report unrecoverable failures
#210 opened Dec 11, 2025 by evacchi Loading…
7
[fs_connector][feat]: Add Python backend implementation for fs backend of offloading connector (fs_connector)
#181 opened Nov 23, 2025 by kfirtoledo Loading…
87
[fs_connector][feat]: Add storage_offload CUDA kernel and setup config
#180 opened Nov 23, 2025 by kfirtoledo Loading…
24
[fs_connector][feat]: Add tensor copy module (tensor_copy) for GPU and CPU block transfers
#179 opened Nov 23, 2025 by kfirtoledo Loading…
16
[fs_connector][feat]: Add multithreaded worker pool (thread_pool)
#178 opened Nov 23, 2025 by kfirtoledo Loading…
27
[fs_connector][feat]: Add file management module (file_io) for fs connector
#176 opened Nov 23, 2025 by kfirtoledo Loading…
56
feat: profiling kv cache index implementations (#108)
#175 opened Nov 22, 2025 by kartikx Loading…
9
feat: avg hit rate metric
#166 opened Nov 18, 2025 by kyanokashi Loading…
1
Bump aiohttp from 3.9.5 to 3.12.14 in /services/uds_tokenizer dependencies Pull requests that update a dependency file python Pull requests that update python code
#152 opened Oct 28, 2025 by dependabot bot Loading…
Fix lexical error
#128 opened Sep 17, 2025 by romsharon98 Loading…
1
Bump pillow from 11.2.1 to 11.3.0 in /pkg/preprocessing/chat_completions dependencies Pull requests that update a dependency file python Pull requests that update python code
#105 opened Sep 4, 2025 by dependabot bot Loading…
Bump torch from 2.5.1 to 2.7.1+cpu in /pkg/preprocessing/chat_completions dependencies Pull requests that update a dependency file python Pull requests that update python code
#99 opened Aug 29, 2025 by dependabot bot Loading…
Reuse chained xxhash BlockHasher
#97 opened Aug 25, 2025 by sagearc Loading…
Created channel interface for KVEvents processing and added unit test cases
#77 opened Aug 3, 2025 by praddy26 • Draft
11
KV Cache aware scheduler performance enhancement. Work in Progress !!!
#70 opened Jul 29, 2025 by srampal • Draft
Bump pillow from 11.2.1 to 11.3.0 in /pkg/preprocessing/chat_completions_template dependencies Pull requests that update a dependency file python Pull requests that update python code
#60 opened Jul 19, 2025 by dependabot bot Loading…
Bump torch from 2.7.0 to 2.7.1 in /pkg/preprocessing/chat_completions_template dependencies Pull requests that update a dependency file python Pull requests that update python code
#59 opened Jul 19, 2025 by dependabot bot Loading…
ProTip! Filter pull requests by the default branch with base:main.