Skip to content

Pull requests: huggingface/trl

New pull request New
34 Open 1,089 Closed
34 Open 1,089 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

🧪 [Experimental] Train LeRobot policy with TRL
#2359 opened Nov 15, 2024 by qgallouedec • Draft
5 tasks
1
⚠️ Add warning guidelines and update codebase to follow best practices
#2350 opened Nov 11, 2024 by qgallouedec • Draft
5 tasks
63
👩‍🏫 Add SFT notebook for chatbot development
#2321 opened Nov 4, 2024 by qgallouedec • Draft
5 tasks
1
[Draft] Add eval_data_collator arg
#2311 opened Nov 3, 2024 by pdufour • Draft
1 of 5 tasks
[Draft] Add autocast to prediction_step for SFTTrainer
#2310 opened Nov 3, 2024 by pdufour • Draft
2 of 5 tasks
Added GitHub Star api and added back to top button in the file.
#2297 opened Oct 30, 2024 by hackit-coder Loading…
3 of 5 tasks
1
🤏 New models for tests
#2287 opened Oct 27, 2024 by qgallouedec • Draft
7 tasks
1
1
🔀 Add MergeModelCallBack
#2282 opened Oct 25, 2024 by August-murr Loading…
4 of 5 tasks
1
@lewtun
69
Asynchronous RLHF: Faster and More Efficient Online DPO
#2278 opened Oct 24, 2024 by mnoukhov Loading…
1 of 3 tasks
4
[GKD] add ULD type loss to GKD Trainer
#2263 opened Oct 22, 2024 by kashif Loading…
2
Data mixer Integration
#2240 opened Oct 16, 2024 by August-murr • Draft
3 of 5 tasks
1
[SFT VLM] Added support for Molmo models via standalone script sft_vlm_molmo
#2236 opened Oct 15, 2024 by sergiopaniego Loading…
2 of 5 tasks
1
5
[online-DPO] evaluaiton step error 🐛 bug Something isn't working
#2231 opened Oct 15, 2024 by kashif • Draft
1
1
Remove ds_config scheuduler params to prevent deepseed from creating scheduler for ref_model
#2224 opened Oct 11, 2024 by Ben-Schneider-code Loading…
2 of 5 tasks
1
1
fixed: OverflowError: out of range integral type conversion attempted
#2206 opened Oct 9, 2024 by himanshushukla12 Loading…
1 of 5 tasks
1
13
Add VAS to TRL ✨ enhancement New feature or request
#2195 opened Oct 7, 2024 by idanshen Loading…
5
[CGPO] CGPO Trainer (single task single objective) ✨ enhancement New feature or request
#2190 opened Oct 6, 2024 by gaetanlop • Draft
9 of 10 tasks
1
Change KTO tokenization to use DPO's 🏋 KTO Related to KTO
#2187 opened Oct 6, 2024 by kawine Loading…
16
🤝 Mixture of judges 👨‍⚖️ judge Related to judges
#2159 opened Oct 3, 2024 by gaetanlop Loading…
4 tasks done
27
Remove graph breaks for torch.compile() in padding free branch in DataCollatorForCompletionOnlyLM 🐛 bug Something isn't working 🏋 SFT Related to SFT
#2158 opened Oct 3, 2024 by Abhishek-TAMU Loading…
1 of 5 tasks
7
populate SUPPORTED_COMMANDS cli
#2157 opened Oct 2, 2024 by grumpyp Loading…
4 of 5 tasks
1
7
Process-supervised RM Trainer
#2127 opened Sep 26, 2024 by gaetanlop • Draft
5 tasks done
65
[SCoRE] initial score stage 1
#2115 opened Sep 24, 2024 by kashif • Draft
1
Remove deprecated args in trainers
#2036 opened Sep 8, 2024 by qgallouedec • Draft
5 tasks
4
feat: add support for packing tokenized datasets
#2011 opened Sep 3, 2024 by kmehant Loading…
3 of 5 tasks
1
12
ProTip! Updated in the last three days: updated:>2024-11-15.