xlite-dev

All

31 repositories

flux-faster
Public
A forked version of flux-fast that makes flux-fast even faster with cache-dit, 3.3x speedup on NVIDIA L20.
flux flux-dev flux-fill flux-kontext flux-fast cache-dit
Python
•0•12•0•0•Updated Jul 18, 2025Jul 18, 2025
flux-fast
Public
A forked version of flux-fast that makes flux-fast even faster with cache-dit.
Python
•8•5•0•0•Updated Jul 18, 2025Jul 18, 2025
diffusers
Public
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.
Python
•
Apache License 2.0
•6.1k•0•0•0•Updated Jul 18, 2025Jul 18, 2025
torchlm
Public
💎An easy-to-use PyTorch library for face landmarks detection: training, evaluation, inference, and 100+ data augmentations.🎉
heatmap regression pip data-augmentation face-landmarks mobilenet shufflenet torchvision albumentations yolov5
Python
•
MIT License
•25•261•15•0•Updated Jul 16, 2025Jul 16, 2025
LeetCUDA
Public
📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉
cuda cuda-kernels cuda-demo cuda-toolkit cuda-library cuda-kernel learn-cuda cuda-cpp hgemm flash-attention
Cuda
•
GNU General Public License v3.0
•591•5.6k•8•0•Updated Jul 16, 2025Jul 16, 2025
cache-dit
Public
🤗CacheDiT: A Training-free and Easy-to-use Cache Acceleration Toolbox for Diffusion Transformers🔥
Python
•
Other
•4•4•0•0•Updated Jul 15, 2025Jul 15, 2025
SpargeAttn
Public
SpargeAttention: A training-free sparse attention that can accelerate any model inference.
Cuda
•
Apache License 2.0
•48•6•0•0•Updated Jul 14, 2025Jul 14, 2025
SageAttention
Public
Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.
Cuda
•
Apache License 2.0
•158•0•0•0•Updated Jul 14, 2025Jul 14, 2025
nunchaku
Public
[ICLR2025 Spotlight] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models
Python
•
Apache License 2.0
•125•2•0•0•Updated Jul 14, 2025Jul 14, 2025
Awesome-DiT-Inference
Public
📚A curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Cache, Quantization, Parallelism, etc.🎉
flux wan diffusion dit sora stable-diffusion sdxl sd15 deepcache open-sora-plan
Python
•
GNU General Public License v3.0
•17•326•0•0•Updated Jul 14, 2025Jul 14, 2025
Awesome-LLM-Inference
Public
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
mla vllm llm-inference awesome-llm flash-attention tensorrt-llm paged-attention deepseek flash-attention-3 deepseek-v3
Python
•
GNU General Public License v3.0
•294•4.2k•0•0•Updated Jul 14, 2025Jul 14, 2025
lite.ai.toolkit
Public
🛠 A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉
tensorrt mnn ncnn onnx onnxruntime yolov5 tnn mnn-model yolox robustvideomatting
C++
•
GNU General Public License v3.0
•750•4.2k•1•0•Updated Jul 14, 2025Jul 14, 2025
lihang-notes
Public
📚《统计学习方法-李航: 笔记》 200页PDF，公式细节讲解🎉
svm kd-tree ml statistics-learning lihang li-hang lihang-code lihang-notes li-hang-notes
Shell
•
GNU General Public License v3.0
•57•468•2•0•Updated Jul 13, 2025Jul 13, 2025
FlagGems
Public
FlagGems is an operator library for large language models implemented in the Triton Language.
Python
•
Apache License 2.0
•110•0•0•0•Updated Jul 11, 2025Jul 11, 2025
.github
Public
0•1•0•0•Updated Jun 24, 2025Jun 24, 2025
draft-attention
Public
Code for Draft Attention
Python
•2•1•0•0•Updated May 22, 2025May 22, 2025
HGEMM
Public
⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
cuda tensor-cores hgemm
Cuda
•
GNU General Public License v3.0
•4•87•0•0•Updated May 10, 2025May 10, 2025
ffpa-attn
Public
⚡️FFPA: Extend FlashAttention-2 with Split-D, achieve ~O(1) SRAM complexity for large headdim, 1.8x~3x↑ vs SDPA.🎉
cuda attention sdpa mla mlsys tensor-cores flash-attention deepseek deepseek-v3 deepseek-r1
Cuda
•
GNU General Public License v3.0
•8•192•1•0•Updated May 10, 2025May 10, 2025
xlite-cli
Public
The cli version of lite.ai.toolkit
C++
•0•1•0•0•Updated Apr 9, 2025Apr 9, 2025
flashinfer
Public
FlashInfer: Kernel Library for LLM Serving
Cuda
•
Apache License 2.0
•387•0•0•0•Updated Mar 23, 2025Mar 23, 2025
tutorial-template
Public template
Template for the Read the Docs tutorial
Python
•1.6k•0•0•0•Updated Aug 9, 2024Aug 9, 2024
RVM-Inference
Public
🔥Robust Video Matting C++ inference toolkit with ONNXRuntime、MNN、NCNN and TNN, via lite.ai.toolkit.
cpp matting mnn ncnn onnx onnxruntime tnn robustvideomatting
C++
•
GNU General Public License v3.0
•27•129•20•0•Updated Jul 29, 2024Jul 29, 2024
netron-vscode-extension
Public
☕️ A vscode extension for netron, support *.pdmodel, *.nb, *.onnx, *.pb, *.h5, *.tflite, *.pth, *.pt, *.mnn, *.param, etc.
deeplearning paddle mnn ncnn onnx onnxruntime yolov5 tnn netron yolov8
TypeScript
•
Other
•0•13•3•0•Updated Jun 4, 2023Jun 4, 2023
yolov5face-toolkit
Public
YOLO5Face 2021 with MNN/NCNN/TNN/ONNXRuntime
cpp yolov5-face-landmark yolo5face yolov5face yolov5-face yolo5-face yolov7-face yolov8-face
C++
•
GNU General Public License v3.0
•8•58•6•0•Updated Apr 21, 2023Apr 21, 2023
ssrnet-toolkit
Public
SSRNet: 190 Kb!! Super fast Age Estimation with MNN/TNN/ONNXRuntime C++.
ssrnet
C++
•
GNU General Public License v3.0
•0•3•0•0•Updated Feb 4, 2022Feb 4, 2022
fsanet-toolkit
Public
FSANet: 1 Mb!! Head Pose Estimation with MNN、TNN and ONNXRuntime C++.
fsanet
C++
•
GNU General Public License v3.0
•2•17•0•0•Updated Feb 4, 2022Feb 4, 2022
mgmatting-toolkit
Public
MGMatting with MNN/TNN/ONNXRuntime C++, GPU/CPU, support dynamic shape.
cpp matting mnn onnxruntime tnn mgmatting
C++
•
GNU General Public License v3.0
•2•7•1•0•Updated Feb 3, 2022Feb 3, 2022
scrfd-toolkit
Public
Super fast accurate face detector ! SCRFD(CVPR 2021) with MNN/TNN/NCNN/ONNXRuntime C++.
mnn ncnn onnxruntime tnn scrfd
C++
•
GNU General Public License v3.0
•3•17•0•0•Updated Jan 12, 2022Jan 12, 2022
nanodet-toolkit
Public
NanoDet、NanoDet-Plus with ONNXRuntime/MNN/TNN/NCNN C++.
mnn ncnn onnxruntime tnn nanodet
C++
•
GNU General Public License v3.0
•7•28•2•0•Updated Dec 27, 2021Dec 27, 2021
yolox-toolkit
Public
YOLOX with NCNN/MNN/TNN/ONNXRuntime C++.
yolox
C++
•
GNU General Public License v3.0
•1•13•1•0•Updated Dec 18, 2021Dec 18, 2021