Labels

• ⏳ needs more info

  Additional information or clarification is required to proceed
• ⚡ PEFT

  Related to PEFT
• ⚡accelerate

  Related to accelerate
• ✨ enhancement

  New feature or request
• ❓ question

  Seeking clarification or more information
• 🏋 DPO

  Related to DPO
• 🏋 DPPO

  Related to DDPO
• 🏋 GKD

  Related to GKD
• 🏋 GRPO

  Related to GRPO
• 🏋 Iterative SFT

  Related to Iterative SFT
• 🏋 KTO

  Related to KTO
• 🏋 Online DPO

  Related to Online DPO
• 🏋 ORPO

  Related to ORPO
• 🏋 PPO

  Related to PPO
• 🏋 PRM

  Related to PRM
• 🏋 Reward

  Related to Reward modelling
• 🏋 RLOO

  Related to RLOO
• 🏋 SFT

  Related to SFT
• 🏋 XPO

  Related to XPO
• 🐛 bug

  Something isn't working
• 👁️ VLM

  Related to Visual Language Models
• 👥 duplicate

  This issue or pull request already exists
• 👨‍⚖️ judge

  Related to judges
• 👶 good first issue

  Good for newcomers
• 📚 documentation

  Improvements or additions to documentation
• 📱 cli

  Related to the Command-line interface
• 🗃️ data

  Related to data
• 😴 stale

  No update from the author, will be closed soon
• 🙋 help from community wanted

  Open invitation for community members to contribute
• 🚀 deepspeed

  Related to deepspeed