0.0.15

github-actions released this 07 Mar 02:26

· 768 commits to master since this release

c60ac6e

Adds Q4 cache mode
Support for StarCoder2
Minor optimizations and a couple of bugfixes

Full Changelog: v0.0.14...v0.0.15

Assets 31