Skip to content

Commit

Permalink
ggml : AVX IQ quants (#7845)
Browse files Browse the repository at this point in the history
* initial iq4_xs

* fix ci

* iq4_nl

* iq1_m

* iq1_s

* iq2_xxs

* iq3_xxs

* iq2_s

* iq2_xs

* iq3_s before sllv

* iq3_s

* iq3_s small fix

* iq3_s sllv can be safely replaced with sse multiply
  • Loading branch information
netrunnereve authored Jun 21, 2024
1 parent a927b0f commit 7d5e877
Showing 1 changed file with 698 additions and 1 deletion.
Loading

0 comments on commit 7d5e877

Please sign in to comment.