Skip to content

Commit

Permalink
Merge remote-tracking branch 'origin/main' into UnshardSkipKeys
Browse files Browse the repository at this point in the history
  • Loading branch information
dirkgr committed Oct 24, 2023
2 parents c1b4add + 4980bad commit b4b6fb4
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions configs/v1_5-mix-medium-mitch-ish-mcli.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -73,6 +73,7 @@ load_path: null
max_duration: 476837 # 2T tokens
global_train_batch_size: 2048
device_train_microbatch_size: 2
time_limit: null

precision: amp_bf16

Expand Down

0 comments on commit b4b6fb4

Please sign in to comment.