will add dapo for RL？ #2672
-
|
dapo is better than grpo |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 3 replies
-
|
Hey, for DAPO, are you referring to the DAPO loss type for GRPO or DAPO https://github.com/BytedTsinghua-SIA/DAPO (which seems to be a form of PPO)? If the former, you can already do so via passing the trl:
loss_type: dr_grpo |
Beta Was this translation helpful? Give feedback.
-
|
Added a PR here to help clarify in docs #2673 |
Beta Was this translation helpful? Give feedback.
-
|
DAPO: https://github.com/volcengine/verl/blob/gm-tyx/puffin/main/recipe/dapo/src/dapo_ray_trainer.py |
Beta Was this translation helpful? Give feedback.
-
|
Oh okay. Just looked at paper briefly. I thought they were two different things 😄 |
Beta Was this translation helpful? Give feedback.
Hey, for DAPO, are you referring to the DAPO loss type for GRPO or DAPO https://github.com/BytedTsinghua-SIA/DAPO (which seems to be a form of PPO)?
If the former, you can already do so via passing the
loss_type