Search results

question about GPU memory consumption

Status: Open.

#36 In MoonshotAI/MoBA;

· alleztous opened on Jul 11, 2025

moba注意力机制是否可以不经过训练直接插入其他模型中使用？

Status: Open.

#35 In MoonshotAI/MoBA;

· YuHuiGao opened on Jun 16, 2025

Question on Implementing Context Parallelism with MoBA Efficient Attention

Status: Open.

#34 In MoonshotAI/MoBA;

· weiye666 opened on May 27, 2025

mismatch max_seqlen in _flash_attn_varlen_forward

Status: Open.

#32 In MoonshotAI/MoBA;

· ZetangForward opened on May 2, 2025

Question about MoBA RULER eval

Status: Open.

#29 In MoonshotAI/MoBA;

· martyLY opened on Apr 15, 2025

Question about MoBA Training Approach for LLaMA 3.1-8B

Status: Open.

#24 In MoonshotAI/MoBA;

· bestfleer opened on Mar 24, 2025

Qwen2.5使用moba之后显示sliding window attention相关问题

Status: Open.

#22 In MoonshotAI/MoBA;

· xvlincaigou opened on Mar 16, 2025

Release fine-tuned MoBA models on Hugging Face

Status: Open.

#11 In MoonshotAI/MoBA;

· NielsRogge opened on Feb 25, 2025