generated from fastai/nbdev_template
-
Notifications
You must be signed in to change notification settings - Fork 1.8k
Pull requests: huggingface/trl
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[GRPO] Adds an option to scale the loss by a constant factor
#3231
opened Apr 4, 2025 by
edbeeching
Loading…
remove unused optimizer config in prepare_deepspeed
#3228
opened Apr 3, 2025 by
liguohao96
Loading…
1 of 5 tasks
Fix online DPO crash when model is a DataParallel object
#3225
opened Apr 3, 2025 by
wilrop
Loading…
5 tasks
feat(trainer): Support multi-role & consecutive turns in DataCollatorForCompletionOnlyLM (#3223)
#3224
opened Apr 3, 2025 by
Kirili4ik
Loading…
4 tasks done
🌊 Add error for iterable datasets in GRPOTrainer
#3216
opened Apr 2, 2025 by
qgallouedec
Loading…
5 tasks
📢 Improve GRPO trainer error message for invalid num_generations
#3199
opened Mar 31, 2025 by
AliBakly
Loading…
Support for Models With Pre-Finetuned LoRA Adapters in GRPO: Add use_peft_as_reference Flag
#3196
opened Mar 31, 2025 by
LoganVegnaSHOP
Loading…
5 tasks done
🚀 Enhance GRPO VLLM server from sync to async and accelerate training
#3182
opened Mar 30, 2025 by
binary-husky
Loading…
Co-Locating vLLM w/ training to achieve higher throughput and GPU utilization
#3162
opened Mar 26, 2025 by
toslali-ibm
Loading…
2 of 5 tasks
Fix: Compatibility for
formatting_func returning a list
#3147
opened Mar 24, 2025 by
YeFD
Loading…
4 of 5 tasks
Extend BCO Trainer dataset format support
#3134
opened Mar 22, 2025 by
reihig-ut
Loading…
1 of 5 tasks
Add GRPO/ Online DPO support for quantitative models when use vllm as infer backbone.
#3133
opened Mar 22, 2025 by
maoulee
Loading…
improvement(utils.py): simplify repeating completion string
#3122
opened Mar 20, 2025 by
tpoisonooo
Loading…
feat: Add Interleaved Trainer implementation
#3107
opened Mar 18, 2025 by
ucalyptus2
Loading…
3 tasks done
Previous Next
ProTip!
no:milestone will show everything without a milestone.