Skip to content

Issues: mlc-ai/mlc-llm

Project Tracking
#647 opened Aug 2, 2023 by tqchen
Open
Model Request Tracking
#1042 opened Oct 9, 2023 by CharlieFRuan
Open 4
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

194 Open 1,202 Closed
194 Open 1,202 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Question] How to export MLCChat .apk with weight bundled/included? question Question about the usage
#3013 opened Nov 6, 2024 by lifelongeeek
1
[Bug] Speculative decoding doesn't work on Vulkan (AMD iGPU) bug Confirmed bugs
#3011 opened Nov 4, 2024 by SkyHeroesS
[Question] Android app issue question Question about the usage
#3010 opened Nov 4, 2024 by j0h0k0i0m
2
[Bug] large concurrency service broken bug Confirmed bugs
#3005 opened Oct 31, 2024 by fan-niu
2
[Bug] Llama-3.1-70B-Instruct-q3f16_1-MLC model running across two GPUs with tensor_parallel_shards=2 bug Confirmed bugs
#3004 opened Oct 31, 2024 by shahizat
2
[Bug] DLL error bug Confirmed bugs
#3003 opened Oct 31, 2024 by ArpanDhot
[Bug] Misalignment of Llama3.2 chat template bug Confirmed bugs
#3002 opened Oct 31, 2024 by Hzfengsy
[Question] Error running prep_emcc_deps.sh - 'tvm/runtime/object.h' file not found question Question about the usage
#3001 opened Oct 30, 2024 by Big-Boy-420
6
[Question] Which models do you recommend for compiling on Mac Intel chip, metal gpu? question Question about the usage
#2999 opened Oct 28, 2024 by RINO-GAELICO
[Bug] Llama 3.2 3B and 1B on MLC are significantly slower than Llama 3.1 8B (L40s, fp16) bug Confirmed bugs
#2997 opened Oct 26, 2024 by chrisreese-if
1
[Bug] Bug with DeepSeek V2 bug Confirmed bugs
#2996 opened Oct 25, 2024 by 0xLienid
1
[Question] TVM error on Mac Intel chip, Metal accelerator question Question about the usage
#2995 opened Oct 24, 2024 by RINO-GAELICO
[Bug] Concurrent requests are being run sequentially on AMD MI60 (gfx906) bug Confirmed bugs
#2992 opened Oct 22, 2024 by Said-Akbar
1
Problems encountered while doing Android SDK question Question about the usage
#2986 opened Oct 18, 2024 by whyshifht
1
[Bug] some questions about build Android app with mlc bug Confirmed bugs
#2985 opened Oct 17, 2024 by ecccccsgo
3
[Bug] Running Quick Start Example in Windows gives Error: 'InternalError: Check failed: (it != n->end()) is false: cannot find the corresponding key in the Map and MLCEngine' object has no attribute '_ffi' bug Confirmed bugs
#2983 opened Oct 16, 2024 by Seoulsim
7
[Bug] Running Quick Start Example in Windows gives Error: 'MLCEngine' object has no attribute '_ffi' bug Confirmed bugs
#2979 opened Oct 15, 2024 by jackuh105
3
[Bug] Llama example inference using Vulkan gives build error bug Confirmed bugs
#2977 opened Oct 14, 2024 by asfarkTii
2
[Question] Fail to pip install mlc-llm question Question about the usage
#2974 opened Oct 13, 2024 by xiboliyaxiangjiaojun
7
Error with LLVM Configuration on Windows for GPU Inference in mlc-llm bug Confirmed bugs
#2969 opened Oct 9, 2024 by sreejith-ios
6
[Question] Why phi3.5v inference image is much longer than HF question Question about the usage
#2967 opened Oct 8, 2024 by Liuuuu54
5
InternalError when running llava model question Question about the usage
#2966 opened Oct 7, 2024 by plufz
6
[Bug] ValueError: Unknown model type: rwkv bug Confirmed bugs
#2963 opened Oct 7, 2024 by haohenggang
1
[Model Request] Jiutian 13.9b MoE model new-models
#2935 opened Sep 23, 2024 by 20241123
1
[Question] How do you abort in the event of a memory pressure warning on iOS? question Question about the usage
#2930 opened Sep 22, 2024 by bryan1anderson
ProTip! Find all open issues with in progress development work with linked:pr.