Skip to content

Pull requests: huggingface/trl

New pull request New
87 Open 1,664 Closed
87 Open 1,664 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix wrong logit slicing in grpo _get_per_token_logps_and_entropies
#3682 opened Jul 2, 2025 by ahatamiz Loading…
2 of 5 tasks
1
3
Restore the effect of liger_kernel's monkey_patch on global modules in UT.
#3680 opened Jul 2, 2025 by YangKai0616 Loading…
1
fix: support dict access in SFT Trainer
#3677 opened Jul 2, 2025 by jannisborn Loading…
4 of 5 tasks
1
6
Support FSDP2 in GRPOTrainer
#3670 opened Jun 30, 2025 by thepowerfuldeez Loading…
1
[fix] type error of quantile
#3667 opened Jun 30, 2025 by gitabtion Loading…
1 of 5 tasks
1
2
[SFT] Dry up the sft tests
#3657 opened Jun 27, 2025 by kashif Loading…
5 tasks
1
feat: Initial implementation of RePO trainer and components
#3655 opened Jun 26, 2025 by celsowm Loading…
5 tasks
2
Faster position_ids computation for FFD packing
#3649 opened Jun 25, 2025 by mariosasko Loading…
1 of 5 tasks
7
Ensure Chat Template Safe Prompt Truncation
#3646 opened Jun 25, 2025 by pramodith Loading…
4 of 5 tasks
17
[WIP] vllm-server-spec-dec-support
#3643 opened Jun 24, 2025 by shirinyamani Loading…
5 tasks
1
GRPO: Pack Responses within the same group.
#3642 opened Jun 24, 2025 by pramodith • Draft
4 of 5 tasks
1
Add type hints to dpo_trainer.py
#3631 opened Jun 23, 2025 by bvantuan Loading…
1
🔍 Add guidance on choosing max_length value and include visualizati…
#3630 opened Jun 22, 2025 by qgallouedec Loading…
5 tasks
1
Add Entropy Control to GRPOTrainer
#3628 opened Jun 22, 2025 by 1485840691 Loading…
5
Feature: Add SGLang support for GRPO Trainer
#3627 opened Jun 21, 2025 by PrinsYin • Draft
5 tasks
5
[WIP] [SFT] SFT doc rewrite
#3619 opened Jun 18, 2025 by qgallouedec Loading…
5 tasks
1
ClearML logging of visualization in RewardTrainer evaluation
#3602 opened Jun 16, 2025 by ioverho Loading…
2 of 5 tasks
Fix: corrected fsdp in GRPO trainer
#3582 opened Jun 13, 2025 by tryumanshow Loading…
2 of 5 tasks
8
Check rewards shapes in RewardTrainer
#3577 opened Jun 13, 2025 by ioverho Loading…
4 tasks done
Chisquare regularized DPO
#3573 opened Jun 12, 2025 by asparius Loading…
3
[WIP] 🥳 new rloo
#3533 opened Jun 3, 2025 by shirinyamani Loading…
5 tasks
1
Push KTAE impl
#3518 opened May 30, 2025 by SamComber Loading…
5 tasks
1
intuit
#3513 opened May 29, 2025 by shirinyamani Loading…
5 tasks
1
🎀 New defaults: gradient_checkpointing=True
#3510 opened May 29, 2025 by qgallouedec Loading…
5 tasks
6
Add Bidirectional Knowledge Distillation Option to GKDTrainer
#3508 opened May 29, 2025 by shaischaudhry Loading…
3 of 5 tasks
@kashif
3
ProTip! no:milestone will show everything without a milestone.