Skip to content

Commit

Permalink
Model: Format
Browse files Browse the repository at this point in the history
Signed-off-by: kingbri <[email protected]>
  • Loading branch information
bdashore3 committed Feb 18, 2024
1 parent 7def32e commit a19a4eb
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions backends/exllamav2/model.py
Original file line number Diff line number Diff line change
Expand Up @@ -114,9 +114,7 @@ def progress(loaded_modules: int, total_modules: int,
# Auto GPU split parameters
self.gpu_split_auto = gpu_split_auto

autosplit_reserve_megabytes = unwrap(
kwargs.get("autosplit_reserve"), [96]
)
autosplit_reserve_megabytes = unwrap(kwargs.get("autosplit_reserve"), [96])
self.autosplit_reserve = list(
map(lambda value: value * 1024**2, autosplit_reserve_megabytes)
)
Expand Down

0 comments on commit a19a4eb

Please sign in to comment.