Skip to content

Issues: NVIDIA/TensorRT-Model-Optimizer

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

83 Open 87 Closed
83 Open 87 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Support for W4A16 and W4A8 Quantization in TensorRT Model Optimizer feature request New feature or request
#189 opened Apr 30, 2025 by david-PHR
Cannot serve modelopt quantized nvfp4 model on TensorRT LLM bug Something isn't working
#187 opened Apr 27, 2025 by enisaras
@meenchen
2
[BUG] modelopt restore quantized models using 'AutoModelForCausalLM.from_pretrained' doesn't work for mixtral-8x7b bug Something isn't working
#186 opened Apr 27, 2025 by wanzhenchn
3
[BUG] modelopt restore using 'from_pretrained' doesn't work in diffusers bug Something isn't working
#185 opened Apr 25, 2025 by ishan-modi
@kevalmorabia97
2
Support more Quantization methods for "onnx_ptq"? feature request New feature or request
#184 opened Apr 24, 2025 by s101010tw
@i-riyad
[BUG] Issue processing NF4 double quantization bug Something isn't working
#183 opened Apr 22, 2025 by ishan-modi
@meenchen
1
Qwen2_MoE AWQ(w4a16/w4a8) quantization failed with Nan AssertionError
#182 opened Apr 22, 2025 by wanzhenchn
@meenchen
1
QAT weight load error bug Something isn't working
#180 opened Apr 18, 2025 by white-wolf-tech
@realAsma
3
Torch Quantization: Allow restoring quantized model and re-running calibration on new data (PTQ) feature request New feature or request
#179 opened Apr 16, 2025 by david-PHR
@realAsma
1
Run w4a8 quant for deepseek r1 on 8xH20 OOM
#177 opened Apr 14, 2025 by Kiokana
1
Pruning a subset of the layers
#176 opened Apr 11, 2025 by phantaurus
@kevalmorabia97
14
Explicit INT8 Quantization Fails to Fuse Concat-Conv Block Compared to Implicit Mode
#174 opened Apr 9, 2025 by patrickgrommelt
@i-riyad
1
Getting Real quantization not supported for this format error when using mtq.compress(model)
#171 opened Apr 5, 2025 by RivenSama
@meenchen
1
SDPA Int8 Quantisation using MTQ
#170 opened Apr 4, 2025 by satya-penamakuri
@jingyu-ml
ViT-L - int8 quantization and throughput
#167 opened Apr 2, 2025 by mkompanek
@i-riyad
5
slower when quantize whole bert model than quantize only ffn
#159 opened Mar 20, 2025 by DamonsJ
11
int4 quantization output onnx does not load bug Something isn't working
#156 opened Mar 13, 2025 by thejaswi01
@i-riyad
1
pi0 support?
#151 opened Mar 9, 2025 by johnnynunez
4
PyTorch Quantization Failed to Quantize Scaled Dot Product
#149 opened Mar 7, 2025 by YixuanSeanZhou
@jingyu-ml
10
[RFC] TensorRT Model Optimizer - Product Roadmap roadmap
#146 opened Mar 6, 2025 by omrialmog
@omrialmog
Not support torch.compile() ?
#145 opened Mar 5, 2025 by Vieeo
1
Quantized model size is larger than the original model
#143 opened Mar 1, 2025 by Urania880519
@i-riyad
5
the consistency between modelopt and trt is quite different?
#140 opened Feb 24, 2025 by 666DZY666
@i-riyad
5
trt-modelopt is not compatible with pytorch FSDP？
#139 opened Feb 21, 2025 by Vieeo
3
Restore functionality: lm_head option to disable quantization
#138 opened Feb 20, 2025 by michaelfeil
@cjluo-nv
4
ProTip! Exclude everything labeled bug with -label:bug.