New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reproducing Table3. #57

Open

mjyun01 opened this issue Oct 10, 2024 · 0 comments

mjyun01 commented Oct 10, 2024

CUDA_VISIBLE_DEVICES=0 python opt.py facebook/opt-350m wikitext2 --wbits 3 --new-eval

Table 3 in GPTQ paper reporting wikitext PPL 33.79, but I got 31.90.
How can I get exactly same result with paper?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment