Skip to content

Pull requests: pytorch/torchtitan

New pull request New
231 Open 1,797 Closed
231 Open 1,797 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[graph_trainer] Add Llama3 precompile config, tests, and docs ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2667 opened Mar 23, 2026 by bobrenjc93 • Draft
10
[graph_trainer] Integrate precompile into AOT compilation path ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2665 opened Mar 23, 2026 by bobrenjc93 • Draft
10
[graph_trainer] Add precompile artifact serialization and loading ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2664 opened Mar 23, 2026 by bobrenjc93 • Draft
10
[graph_trainer] Add disk storage adapter for precompile artifacts ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2663 opened Mar 23, 2026 by bobrenjc93 • Draft
10
[rl] Add varlen attention for trainer. ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2649 opened Mar 22, 2026 by zhxchen17 Loading…
2
Set up multi-node RL training on MAST with six_cluster (#2639) ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot. fb-exported meta-exported
#2639 opened Mar 20, 2026 by daniellepintz Loading…
6
[RL] adopt local map attention for vLLM attention ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2638 opened Mar 20, 2026 by acisseJZhong Loading…
9
Fix validator skipping a batch each round by using itertools.islice ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2637 opened Mar 20, 2026 by fegin Loading…
1
5
[graph_trainer] Add Qwen3 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2635 opened Mar 19, 2026 by yiming0416 • Draft
[Module] Refactor init_weights to config-based param_init system ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2633 opened Mar 19, 2026 by fegin Loading…
17
Fix unreachable links in markdown files CLA Signed This label is managed by the Meta Open Source bot.
#2632 opened Mar 19, 2026 by Andrei-Aksionov Loading…
19
[Draft WIP] MoE with LocalMap ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2625 opened Mar 18, 2026 by acisseJZhong • Draft
[DONT LAND] Full Dtensor fully_shard + Local Map + FlexAttention ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2621 opened Mar 18, 2026 by fegin Loading…
2
Only apply grouped GEMM padding for MXFP8 and FP8 non-HybridEP cases ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2620 opened Mar 18, 2026 by danielvegamyhre Loading…
17
[WIP][Full Dtensor] Work with full dtensor fully_shard ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2616 opened Mar 17, 2026 by fegin • Draft
Actually correct training w/ packed datasets defaults ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2610 opened Mar 16, 2026 by joecummings • Draft
[Observability 7/7] Timing spans and step tags across all trainers ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2607 opened Mar 16, 2026 by felipemello1 Loading…
7 tasks done
6
[Observability 6/7] Wire observability into Trainer, Flux, FT, and Forge ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2606 opened Mar 16, 2026 by felipemello1 Loading…
5 tasks done
23
[Observability 5/7] RolloutLogger for RL rollout JSONL with filtering ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2605 opened Mar 16, 2026 by felipemello1 Loading…
3 tasks done
8
[Observability 4/7] MetricsProcessor — throughput, memory, validation, log scheduling ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2604 opened Mar 16, 2026 by felipemello1 Loading…
4 tasks done
12
[Observability 3/7] Experiment metrics with background aggregation subprocess ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2603 opened Mar 16, 2026 by felipemello1 Loading…
4 tasks done
14
[Observability 2/7] Structured system logging and gantt chart generation ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2602 opened Mar 16, 2026 by felipemello1 Loading…
4 tasks done
40
[Observability 1/7] Toy trainers for observability development ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2601 opened Mar 16, 2026 by felipemello1 Loading…
No Weight Decay Keywords CLA Signed This label is managed by the Meta Open Source bot.
#2600 opened Mar 16, 2026 by francesco-bertolotti Loading…
7
add async activation offloading to CPU with pinned memory pool CLA Signed This label is managed by the Meta Open Source bot.
#2581 opened Mar 15, 2026 by dean-mccoppin Loading…
2
ProTip! no:milestone will show everything without a milestone.