Skip to content

Commit

Permalink
Config: Remove developement flag from tensor parallel
Browse files Browse the repository at this point in the history
Exists in stable ExllamaV2 version.

Signed-off-by: kingbri <[email protected]>
  • Loading branch information
bdashore3 committed Aug 22, 2024
1 parent 565b030 commit 364032e
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion config_sample.yml
Original file line number Diff line number Diff line change
Expand Up @@ -112,7 +112,6 @@ model:
# Load model with tensor parallelism
# If a GPU split isn't provided, the TP loader will fallback to autosplit
# Enabling ignores the gpu_split_auto and autosplit_reserve values
# NOTE: Requires a development build of exllamav2
#tensor_parallel: False

# Automatically allocate resources to GPUs (default: True)
Expand Down

0 comments on commit 364032e

Please sign in to comment.