Skip to content

Commit

Permalink
[Grok-1] fix the run-time error "Can't pickle <class 'transformers_mo…
Browse files Browse the repository at this point in the history
…dules.configuration_grok1.Grok1Config'>: it's not the same object as transformers_modules.configuration_grok1.Grok1Config" in fp16/bf16 run (#184)

Co-authored-by: wunhuang <[email protected]>
  • Loading branch information
kkHuang-amd and wunhuang authored Sep 16, 2024
1 parent 72d0cfb commit 0958045
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions vllm/transformers_utils/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -138,6 +138,10 @@ def get_config(
raise RuntimeError(err_msg) from e
else:
raise e
if config.model_type in _CONFIG_REGISTRY:
config_class = _CONFIG_REGISTRY[config.model_type]
config = config_class.from_pretrained(
model, revision=revision, code_revision=code_revision)

elif config_format == ConfigFormat.MISTRAL:
config = load_params_config(model, revision)
Expand Down

0 comments on commit 0958045

Please sign in to comment.