Search results

[BUG] Inaccurate FLOPs Calculation for Models with Specialized Attention

bugSomething isn't workingSomething isn't working

Status: Open.

#1725 In NVIDIA/Megatron-LM;

· NuojCheng opened on Aug 1, 2025

[QUESTION]Why are inputs to ColumnParallelLinear different across ranks in register_forward_hook and register_forward_pre_hook

questionFurther information is requestedFurther information is requested

Status: Open.

#1722 In NVIDIA/Megatron-LM;

· UnbearableFate opened on Jul 31, 2025

Benchmarking DeepEP Guide

module: documentation

module: moe

Status: Open.

#1721 In NVIDIA/Megatron-LM;

· sbhavani opened on Jul 31, 2025

[QUESTION]May I allocate and register NCCL userbuffer for activations/gradients transmitted between PP stages?

community-request

module: training

questionFurther information is requestedFurther information is requested

Status: Open.

#1720 In NVIDIA/Megatron-LM;

· yanminjia opened on Jul 31, 2025

[QUESTION] <code>save_checkpoint</code> with <code>expert_tensor_parallel_size</code>

community-request

module: moe

questionFurther information is requestedFurther information is requested

Status: Open.

#1719 In NVIDIA/Megatron-LM;

· jeromeku opened on Jul 30, 2025

v0.12.2 pretrain failed, 0.14.0rc2 model conversion failed

community-request

module: training

questionFurther information is requestedFurther information is requested

Status: Open.

#1718 In NVIDIA/Megatron-LM;

· justalittlenoob opened on Jul 30, 2025

[QUESTION] Purpose of all2all communication for probs in MoEAlltoAllTokenDispatcher

community-request

module: moe

questionFurther information is requestedFurther information is requested

Status: Open.

#1716 In NVIDIA/Megatron-LM;

· snowpeakz opened on Jul 29, 2025

[BUG] OOB layer acces when using 1F1B scheduler

bugSomething isn't workingSomething isn't working

community-request

module: training

Status: Open.

#1715 In NVIDIA/Megatron-LM;

· ColorfulCookie opened on Jul 29, 2025

[QUESTION] Is tensor_parallel.CheckpointWithoutOutput safe?

community-request

module: training

questionFurther information is requestedFurther information is requested

Status: Open.

#1714 In NVIDIA/Megatron-LM;

· hxhue opened on Jul 29, 2025

[BUG]异步保存参数async-save和断点续训之间存在bug

bugSomething isn't workingSomething isn't working

community-request

module: training

Status: Open.

#1713 In NVIDIA/Megatron-LM;

· Huang-Yun opened on Jul 28, 2025

[BUG] error in loss_mask for gpt dataset class

bugSomething isn't workingSomething isn't working

community-request

Status: Open.

#1711 In NVIDIA/Megatron-LM;

· chetandhembre opened on Jul 26, 2025

Error occured while converting Mistral-7B-v0.3-hf to Mistral-7B-v0.3-mcore

bugSomething isn't workingSomething isn't working

community-request

Status: Open.

#1708 In NVIDIA/Megatron-LM;

· ZiangWu-77 opened on Jul 25, 2025