Skip to content

Commit

Permalink
Update Llama config conversion to include architectures field (#5)
Browse files Browse the repository at this point in the history
Signed-off-by: Mustafa Eyceoz <[email protected]>
  • Loading branch information
Maxusmusti authored Jul 9, 2024
1 parent fc30634 commit 541403f
Showing 1 changed file with 1 addition and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -250,6 +250,7 @@ def _export_config_to_huggingface(config: GPTDolomiteConfig) -> LlamaConfig:
assert config.position_embedding_type == "rope"

original_config = LlamaConfig(
architectures=config.architectures,
vocab_size=config.vocab_size,
max_position_embeddings=config.n_positions,
hidden_size=config.n_embd,
Expand Down

0 comments on commit 541403f

Please sign in to comment.