Skip to content

Commit

Permalink
Merge pull request #27 from DeepLink-org/new_dkx
Browse files Browse the repository at this point in the history
Fix readme
  • Loading branch information
phillipchung authored Oct 23, 2023
2 parents 9825369 + 773c92a commit 18e2734
Showing 1 changed file with 1 addition and 7 deletions.
8 changes: 1 addition & 7 deletions llm/Alpaca-Lora/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -60,11 +60,5 @@ python finetune.py \
{'train_runtime': 3581.7097, 'train_samples_per_second': 41.678, 'train_steps_per_second': 0.325, 'train_tokens_per_second(tgs)': 1228.267, 'train_loss': 0.9499486045739085, 'epoch': 2.99}
```


### 稳定性指标
对于稳定性指标,记录前100个step的Loss。



## 训练目标
训练epoch > 290或者训练时间大于72小时,训练Loss小于 1.01
根据参考配置训练后,训练Loss小于 0.95

0 comments on commit 18e2734

Please sign in to comment.