Feat(QA): Check loss when swapping micro_num and micro_bsz && Check g… · kkscilife/InternLM@b596417 · GitHub

Commit

Feat(QA): Check loss when swapping micro_num and micro_bsz && Check g…

Browse files

…rad norm (InternLM#510)

* unitest_only_forward

* memory_test

* doc fix

* doc fix

* check loss

* check grad norm

* check grad norm

Loading branch information

li126com authored Nov 24, 2023

1 parent 0d3811c commit b596417