Skip to content

Pull requests: huggingface/trl

New pull request New
74 Open 1,554 Closed
74 Open 1,554 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[NashMD] fix the edge case where the model is a peft model
#3473 opened May 20, 2025 by kashif Loading…
5 tasks
1
2
Add support for CB with native transformers
#3471 opened May 20, 2025 by ArthurZucker • Draft
Allow an user to train from a local dataset
#3470 opened May 19, 2025 by gogo2464 Loading…
1 of 5 tasks
12
Add async tool-enabled vLLM server for GRPO training via OpenAI-compatible interface
#3469 opened May 19, 2025 by BjarniHaukur Loading…
5 tasks
1
add support for image inputs in GRPO
#3460 opened May 16, 2025 by hellopahe Loading…
1
1
Initialize reward_kwargs to prevent UnboundLocalError in GRPOTrainer
#3459 opened May 16, 2025 by teilomillet Loading…
LD-DPO support
#3458 opened May 16, 2025 by AIR-hl Loading…
1 of 5 tasks
6
Update grpo.py to fix bugs for cli grpo --reward_funcs my_lib.my_reward
#3454 opened May 16, 2025 by wa008 Loading…
4 of 5 tasks
1
[SFT] add warning if dataset's input_ids exceed max_length
#3449 opened May 15, 2025 by HERIUN Loading…
1 of 5 tasks
Fix logging docs
#3447 opened May 14, 2025 by xingyaoww • Draft
2 of 5 tasks
1
🛠️ quantization support for vllm generation
#3428 opened May 8, 2025 by shirinyamani Loading…
5 tasks
13
Reintroducing step method in ppo_trainer
#3410 opened May 3, 2025 by jskaf34 Loading…
2 of 5 tasks
1
2
fix setup chat format
#3404 opened May 2, 2025 by qgallouedec • Draft
5 tasks
[DPO] Truncation leading to zero'd out samples
#3398 opened May 1, 2025 by LeonEricsson Loading…
2 of 5 tasks
3
Fix GRPO/DAPO/Dr.GRPO documentation: formula corrections and KL divergence clarification
#3395 opened Apr 30, 2025 by JenWei0312 Loading…
1 of 5 tasks
10
Reintroduce generate method for PPOTrainer
#3374 opened Apr 27, 2025 by CloseChoice Loading…
4 tasks done
4
An Unified Example Format Checker
#3373 opened Apr 27, 2025 by innerNULL Loading…
1 of 5 tasks
2
add support for reward func using nn.Module in GRPOTrainer
#3372 opened Apr 27, 2025 by Tavish9 Loading…
1 of 5 tasks
6
[Feat] Suppport SGLang as rollout engine of GRPO trainer
#3370 opened Apr 27, 2025 by ryang-max Loading…
2 of 8 tasks
19
Environments
#3367 opened Apr 26, 2025 by August-murr • Draft
27
[GRPO] adds experimental support for the SSR replay buffer
#3325 opened Apr 18, 2025 by edbeeching • Draft
[vllm] support base_url parameter for vLLM client initialization
#3324 opened Apr 18, 2025 by re-imagined Loading…
19
Allow for saving the PPOTrainer value model (critic model)
#3308 opened Apr 16, 2025 by AMindToThink Loading…
Modified GRPOTrainer to accumulate gradient within a single training batch
#3288 opened Apr 13, 2025 by jarrelscy Loading…
3 of 5 tasks
6
add vllm support for token ids as input
#3280 opened Apr 11, 2025 by wybryan Loading…
2
ProTip! Follow long discussions with comments:>50.