Repositories list

• llm-d-kv-cache

  Public

  llm-d/llm-d-kv-cache’s past year of commit activity
  Distributed KV cache scheduling & offloading libraries

  aiincubating

  Go

  •

  Apache License 2.0

  •68•92•36•26•Updated Dec 26, 2025Dec 26, 2025

• llm-d-inference-sim

  Public

  llm-d/llm-d-inference-sim’s past year of commit activity
  A light weight vLLM simulator, for mocking out replicas.

  incubating

  Go

  •

  Apache License 2.0

  •51•75•19•2•Updated Dec 25, 2025Dec 25, 2025

• llm-d-inference-scheduler

  Public

  llm-d/llm-d-inference-scheduler’s past year of commit activity
  Inference scheduler for llm-d

  kubernetesainetworking+ 2inferencegateway-api

  Go

  •

  Apache License 2.0

  •109•111•42•14•Updated Dec 25, 2025Dec 25, 2025

• llm-d-benchmark

  Public

  llm-d/llm-d-benchmark’s past year of commit activity
  llm-d benchmark scripts and tooling

  incubating

  Jupyter Notebook

  •

  Apache License 2.0

  •42•40•54•9•Updated Dec 24, 2025Dec 24, 2025

• llm-d

  Public

  llm-d/llm-d’s past year of commit activity
  Achieve state of the art inference performance with modern accelerators on Kubernetes

  Shell

  •

  Apache License 2.0

  •271•2.2k•74•79•Updated Dec 19, 2025Dec 19, 2025

• llm-d.github.io

  Public
  Website for llm-d: This repository builds the website seen at llm-d.ai

  documentationopensourceai+ 1docusaurus

  JavaScript

  •21•11•2•0•Updated Dec 11, 2025Dec 11, 2025

• llm-d-routing-sidecar

  Public

  llm-d/llm-d-routing-sidecar’s past year of commit activity
  Incubating P/D sidecar for llm-d

  incubating

  Go

  •

  Apache License 2.0

  •28•16•0•1•Updated Nov 13, 2025Nov 13, 2025

• .github

  Public
  2•0•1•0•Updated Aug 28, 2025Aug 28, 2025

• llm-d-deployer

  Public archive
  Helm charts for llm-d

  helmhelm-chartllm-d

  Shell

  •

  Apache License 2.0

  •56•50•34•17•Updated Jul 22, 2025Jul 22, 2025

• llm-d-model-service

  Public archive
  Simplified model deployment on llm-d

  incubating

  Go

  •

  Apache License 2.0

  •15•28•29•6•Updated Jul 2, 2025Jul 2, 2025

• llm-d-pd-utils

  Public
  Makefile

  •4•5•1•0•Updated May 21, 2025May 21, 2025