Skip to content

Commit

Permalink
Fix typo bloat16 -> bfloat16 (#1257)
Browse files Browse the repository at this point in the history
  • Loading branch information
chiragjn authored Feb 6, 2024
1 parent c7cf381 commit 1072f28
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/axolotl/utils/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -322,7 +322,7 @@ def validate_config(cfg):
LOG.warning("BetterTransformers probably doesn't work with PEFT adapters")
if cfg.fp16 or cfg.bf16:
raise ValueError("AMP is not supported with BetterTransformer")
if cfg.float16 is not True and cfg.bloat16 is not True:
if cfg.float16 is not True and cfg.bfloat16 is not True:
LOG.warning(
"You should probably set bfloat16 or float16 to true to "
"load the model in float16 for BetterTransformers"
Expand Down

0 comments on commit 1072f28

Please sign in to comment.