Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

shape mismatch error #100

Open
Celppu opened this issue May 16, 2023 · 0 comments
Open

shape mismatch error #100

Celppu opened this issue May 16, 2023 · 0 comments

Comments

@Celppu
Copy link

Celppu commented May 16, 2023

With

python quant_infer.py --wbits 4 --load ... /vicuna-7B-GPTQ-4bit-128g/vicuna-7B-GPTQ-4bit-128g.pt --text "piip paap" --max_length 24 --cuda cuda:0

I get
....
size mismatch for lm_head.weight: copying a param with shape torch.Size([32001, 4096]) from checkpoint, the shape in current model is
torch.Size([32000, 4096]).
....

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant