Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
naem1023 authored Apr 3, 2023
1 parent a1b2b1e commit e63bb08
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,8 @@
# 😊 Alpaca-lora for huggingface implementation using Deepspeed and FullyShardedDataParallel 😊


## Update Logs
!!! There's some error when you update torch to 2.0. I'll fix it as soon as possible !!!
## Features
- Multi-GPU training using DeepSpeed and Fully sharded Data Parallel with Accelerate
- Training LLaMA using huggingface, lora, peft
Expand Down Expand Up @@ -34,4 +37,4 @@ python train.py \
--output_dir test-clm
```
The codes are still updated, so maybe there're can be some unexpected error.
I used base code from https://github.com/tloen/alpaca-lora. Thanks a lot!!
I used base code from https://github.com/tloen/alpaca-lora. Thanks a lot!!

0 comments on commit e63bb08

Please sign in to comment.