Skip to content

Commit

Permalink
Config: Update description part 2
Browse files Browse the repository at this point in the history
Forgot to change wording.

Signed-off-by: kingbri <[email protected]>
  • Loading branch information
bdashore3 committed Mar 17, 2024
1 parent 7abbac0 commit 08bcc63
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion config_sample.yml
Original file line number Diff line number Diff line change
Expand Up @@ -103,7 +103,7 @@ model:
# Disable Flash-attention 2. Set to True for GPUs lower than Nvidia's 3000 series. (default: False)
#no_flash_attention: False

# Enable 8 bit cache mode for VRAM savings (slight performance hit).
# Enable different cache modes for VRAM savings (slight performance hit).
# Possible values FP16, FP8, Q4. (default: FP16)
#cache_mode: FP16

Expand Down

0 comments on commit 08bcc63

Please sign in to comment.