v0.2.1

• Add ChunkPress, #40 by @maxjeblick and @giulio98
• Update README, including new huggingface space, #41 and #42 by @SimJeg

v0.2.0

Transformers v4.48 introduced breaking changes handled in this release. The release also features AdaKVPress, the first press allowing head-wise compression by patching the attention functions registered in ALL_ATTENTION_FUNCTIONS since v4.48. When combined with ExpectedAttentionPress, AdaKVPress achieved the best results observed yet on the RULER benchmark (see this post).

• Add AdaKVPress, #38 by @SimJeg and @FFY0
• Handle transformers 4.48, #39 by @SimJeg
• Add InfiniteBench results, #11 by @maxjeblick

v0.1.1

What's Changed

• #33 by @SimJeg fixes a small bug in the pipeline
• #36 by @maxjeblick sets transformers <4.48 as a dependency

Full Changelog: v0.1.0...v0.1.1

v0.1.0

#24 by @maxjeblick and #29 by @SimJeg introduce a non-breaking refactoring:

• a press does not require the compression_ratio input argument anymore as some presses do not explicitly require it (e.g. ThinKPress, SimLayerKVPress). However every press must have a compression_ratio attribute after any forward pass (assertion added in tests) to allow average compression ratio measurement on a benchmark
• the core compression logic has been moved from BasePress.forward_hook to BasePress.compress. BasePress.forward_hook now only checks if compress must be called (pre-filling vs decoding), de-quantize cache before compress and re-quantize it afterwards
• the BasePress does not implement a score method anymore, this has been moved to the ScorerPress with the associated ScorerPress.compress method

Other features:

• Add SimLayerKVPress, #28 by @SimJeg and @dame-cell
• Add ComposedPress, #29 by @SimJeg
• Add KeyReRotationPress, #31 by @maxjeblick and @giulio98
• Fix QuantizedCache, #30 by @maxjeblick
• Add new tests, including an integration test on a sample from RULER

v0.0.4

• Add ThinKPress, #20 by @SimJeg and @yuhuixu1993

v0.0.3

• Update speed and memory plots, #10 by @maxjeblick
• Add TOVAPress, #12 by @SimJeg and @hassidm

v0.0.2

• Add support for QuantizedCache, #5 by @SimJeg
• Add colab demo notebook, #6 by @maxjeblick

Initial release

v0.0.1

install poetry in workflows (#1)