Skip to content

fixbug, ensure FP32 accumulation for dW in Llama-mode RMSNorm backward#950

Open
niyunsheng wants to merge 1 commit intolinkedin:mainfrom
niyunsheng:rms_norm
Open

fixbug, ensure FP32 accumulation for dW in Llama-mode RMSNorm backward#950
niyunsheng wants to merge 1 commit intolinkedin:mainfrom
niyunsheng:rms_norm

Commits