Skip to content

Commit

Permalink
Feature/llama factory llama2 pipeline (#95)
Browse files Browse the repository at this point in the history
* added llama-factory under llm_rl

* added sft training bash

* added datasets from llama-factory; will delete later

* finished llama-2-13b train and inference

* fixed minor errors

* changed config

* added deepspeed config

* added more training config to train bash

* adding fix for wandb tags and distributed ranks

* added fastchat data to replicate training for 2k

* tyring to replicate fastchat as close as possible

* before merging

* changed finetue scripts for better performance

* added new data

* example bash

* example bash for mistral
  • Loading branch information
Jasonqi146 authored and ruiyiw committed Nov 14, 2023
1 parent 07ee480 commit 9044163
Showing 0 changed files with 0 additions and 0 deletions.

0 comments on commit 9044163

Please sign in to comment.