Skip to content

Commit

Permalink
Turn off fix untrained tokens
Browse files Browse the repository at this point in the history
  • Loading branch information
@chiragjn
chiragjn committed Dec 8, 2024
1 parent 20bed1c commit cccdc20
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion config-base.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ early_stopping_patience: 10
eval_sample_packing: False
eval_steps: 0.1
eval_strategy: steps
fix_untrained_tokens: True
fix_untrained_tokens: False
gradient_accumulation_steps: 4
gradient_checkpointing: True
gradient_checkpointing_kwargs:
Expand Down

0 comments on commit cccdc20

Please sign in to comment.