Skip to content

Pull requests: huggingface/trl

New pull request New
93 Open 2,397 Closed
93 Open 2,397 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add reward shaping to PPOTrainer
#4774 opened Jan 5, 2026 by derivative2002 Loading…
5 tasks
make dpo compatible with qwen3vl
#4773 opened Jan 4, 2026 by flutist Loading…
Set float32 as default dtype for testing tiny models
#4770 opened Jan 2, 2026 by albertvillanova Loading…
1
3
Add revision override mechanism for testing tiny models
#4769 opened Jan 2, 2026 by albertvillanova Loading…
5
feat(sft): add generation-based evaluation support to SFTTrainer
#4768 opened Jan 2, 2026 by CodersAcademy006 Loading…
1
[GOLD] add probability merging fix to implement chain rule
#4765 opened Dec 30, 2025 by kashif Loading…
5 tasks
1
5
ORPO: Avoid catastrophic cancellation in loss function
#4763 opened Dec 29, 2025 by hartmans Loading…
3 tasks
Sudoku GRPO example script using TextArena
#4762 opened Dec 29, 2025 by sergiopaniego Loading…
5 tasks
11
Add a config to limit the number of tool calling iterations.
#4761 opened Dec 29, 2025 by pramodith Loading…
4 of 5 tasks
1
1
[Docs] Add SRL (Supervised Reinforcement Learning) to Community Tutorials
#4758 opened Dec 29, 2025 by s23deepak Loading…
2 tasks done
Extend CLI to orpo trainer
#4757 opened Dec 27, 2025 by murilo-cunha Loading…
3 of 5 tasks
fix: handle None eval_dataset in example code
#4756 opened Dec 27, 2025 by ciaoyizhen Loading…
1 of 4 tasks
1
perf: avoid output_hidden_states when only last_hidden_state is used
#4755 opened Dec 27, 2025 by ciaoyizhen Loading…
2 of 5 tasks
1
vllm parameter passthrough for stop sequences
#4754 opened Dec 26, 2025 by kdubovikov Loading…
Fix GRPO scale_rewards type specification to fix __post_init__ validation
#4752 opened Dec 26, 2025 by apalmas-saifh Loading…
1 of 5 tasks
Clarify Accelerate usage in SFTTrainer documentation
#4744 opened Dec 23, 2025 by Likhita-17 Loading…
1 task done
2
fix minillm trainer
#4743 opened Dec 23, 2025 by t1101675 Loading…
5 tasks
3
[GRPOTrainer]: Agent Training Supports Async Tool Calls
#4742 opened Dec 23, 2025 by pramodith Loading…
5 tasks done
9
[WIP - Awaiting Feedback] feat: Bidirectional masked importance sampling ratio (MIS) for IcePop
#4732 opened Dec 20, 2025 by casinca • Draft
5 tasks
1
Fix MiniLLM Training
#4731 opened Dec 20, 2025 by t1101675 Loading…
2
Up to 50% less VRAM during forward with forward_masked_logits function
#4729 opened Dec 20, 2025 by qgallouedec Loading…
4
Improve PEFT integration
#4723 opened Dec 19, 2025 by qgallouedec Loading…
6
Refactor vLLM generation [2/N]: Decouple rollout_func and vLLM functionalities
#4712 opened Dec 17, 2025 by albertvillanova • Draft
1
Refactor vLLM generation [1/N]: Extract vLLM generation
#4700 opened Dec 16, 2025 by albertvillanova Loading…
18
fix: invalidate ZeRO-3 param coordinator trace in add_hooks
#4693 opened Dec 15, 2025 by roycho96 Loading…
1 of 5 tasks
@kashif
6
ProTip! Type g i on any issue or pull request to go back to the issue listing page.