The guess reason of the poor training performance

[zhoujiawei3]

Is it possible that the poor training performance is related to the linear learning rate scheduler?

[knight-fzq]

I try to use cosine, but the training collapse after a certain steps (on other task).