Skip to content

[Megatron] support MoE (Qwen2-Moe & Qwen3-MoE)#4012

Merged
Jintao-Huang merged 15 commits intomodelscope:mainfrom
Jintao-Huang:support_megatron_moe
Apr 28, 2025

Commits

Commits on Apr 27, 2025

Commits on Apr 28, 2025