New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

please include quantize utility #1300

Open

0wwafa opened this issue Jan 5, 2025 · 3 comments

0wwafa commented Jan 5, 2025

please include the quantize utility in the release.

Owner

LostRuins commented Jan 6, 2025

It's already there, you can get the tools from https://kcpptools.concedo.workers.dev/

Look for quantize gguf

Author

0wwafa commented Jan 15, 2025

I just think this should be in the main kobold release. convert and quantize are used a lot.

Owner

LostRuins commented Jan 16, 2025

That's tricky, because convert requires pytorch installed to work

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment