Skip to content

Issues: pytorch/torchtitan

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

101 Open 243 Closed
101 Open 243 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Question about fixed std=0.02 initialization of w1 in moe.py question Further information is requested
#1257 opened Jun 3, 2025 by trestad
1
[Deepseek] Router collapse on deepseek training loop enhancement New feature or request
#1246 opened May 30, 2025 by xuanzhang816
@lessw2020
[Bug] Potential bugs in "_grouped_mm" in Llama4 MoE codes
#1237 opened May 29, 2025 by raymin0223
@tianyu-l
5
[PP] PP report loss=-1 when LOG_RANK=gpu_nums -1
#1232 opened May 28, 2025 by aahehehe
9
[kernels] Triton kernels (all2allV) do not work on B200 Blackwell "ValueError: Pointer argument (at 0) cannot be accessed from Triton (cpu tensor?)"
#1225 opened May 26, 2025 by lessw2020
How to pretrain from scratch a Qwen 2.5 7B-base model using Torchtitan?
#1223 opened May 25, 2025 by tjoymeed
2
[Flux] Incorrect loss after loading from checkpoint
#1213 opened May 21, 2025 by CarlosGomes98
@wwwjn
10
[RFC] validation and evaluation in torchtitan
#1210 opened May 20, 2025 by tianyu-l
4
float8 rowwise vanilla TP low throughput bug Something isn't working module: float8
#1207 opened May 20, 2025 by danielvegamyhre
Save RNG states during checkpointing for deterministic debugging enhancement New feature or request
#1194 opened May 14, 2025 by wwwjn
@wwwjn
document the usage of environment variables better_engineering Repo code quality improvements documentation Improvements or additions to documentation high priority triage review
#1192 opened May 14, 2025 by tianyu-l
Can we support outputting checkpoints directly in .pt format? enhancement New feature or request module: checkpoint
#1177 opened May 9, 2025 by andrewor14
@fegin
8
how to inference with pretrained model?
#1169 opened May 6, 2025 by dragen1860
1
[Flux] Flux Issue Tracking
#1151 opened Apr 28, 2025 by wwwjn
6 of 17 tasks
@wwwjn
2
[Feature] Support validation
#1150 opened Apr 28, 2025 by CarlosGomes98
@wwwjn
4
[Question] FSDP+TP CUDA_DEVICE_MAX_CONNECTIONS documentation Improvements or additions to documentation module: fsdp question Further information is requested
#1147 opened Apr 27, 2025 by ChenchaoZhao
3
Inconsistent loss when resume training with vocab size that is not divisible by world size. high priority module: checkpoint triage review
#1136 opened Apr 23, 2025 by weixuansun
4
fully_shard() for huggingface model: pytorch caches too much GPU memory module: fsdp question Further information is requested
#1126 opened Apr 21, 2025 by mingdianliu
4
[DeepSeek MoE] current workstream planning enhancement New feature or request
#1125 opened Apr 21, 2025 by lessw2020
@lessw2020
1
Llama 4 issue tracking high priority triage review
#1118 opened Apr 17, 2025 by tianyu-l
3 of 14 tasks
6
Seeing - "Recomputed values for the following tensors have different metadata than during the forward pass." high priority triage review
#1117 opened Apr 17, 2025 by githubsgi
@soulitzer
19
FSDP2 root level parameter management module: fsdp question Further information is requested
#1091 opened Apr 11, 2025 by dingqingy
1
@tianyu-l
3
Torch.compile and TP during multiresolution Training module: torch.compile question Further information is requested
#1081 opened Apr 9, 2025 by nighting0le01
2
Is the currnet configuration system over-engineered? question Further information is requested
#1055 opened Apr 3, 2025 by wangkuiyi
2
Clarify PP split point documentation. question Further information is requested
#1054 opened Apr 3, 2025 by githubsgi
1
ProTip! Exclude everything labeled bug with -label:bug.