Skip to content

Commit

Permalink
Create live1+_evaluate for coin evaluation (please modify with your o…
Browse files Browse the repository at this point in the history
…wn ckpt path)
  • Loading branch information
chenjoya authored Jul 29, 2024
1 parent c07b113 commit dcbf486
Showing 1 changed file with 12 additions and 0 deletions.
12 changes: 12 additions & 0 deletions scripts/coin/live1+_evaluate
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
deepspeed evaluate.py \
--live_version live1+ \
--eval_datasets coin_step_test coin_next_test coin_task_test coin_procedure_test coin_taskprocedure_test \
--per_device_train_batch_size 1 \
--per_device_eval_batch_size 1 \
--prediction_loss_only False \
--dataloader_num_workers 16 \
--bf16 True \
--tf32 True \
--report_to tensorboard \
--output_dir outputs/coin_benchmarks/live1+ \
--resume_from_checkpoint /path/your/lora_ckpt_folder

0 comments on commit dcbf486

Please sign in to comment.