No clip to loss within Qwen2VLGRPOTrainer #21
Description
Hey in the original paper there is a clip term that I don't see here, during training the grad norm can sometimes be pretty high, leading to instability
{{ message }}
Hey in the original paper there is a clip term that I don't see here, during training the grad norm can sometimes be pretty high, leading to instability