Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Include quantization techniques #78

Open
filopedraz opened this issue Oct 7, 2023 · 0 comments
Open

Include quantization techniques #78

filopedraz opened this issue Oct 7, 2023 · 0 comments
Assignees
@casperdcl
Labels
content text & code

Comments

@filopedraz
Copy link
Contributor

Type

new chapter

Chapter/Page

Something else

Description

I suggest that we have a separate chapter on Quantization. The chapter should include all the new methods created to handle quantization and the most famous libraries associated with them.

  • GPTQ
  • AWQ
@filopedraz filopedraz added the content text & code label Oct 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@casperdcl casperdcl

Labels
content text & code
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@casperdcl @filopedraz