Skip to content

v0.1.5
Compare
Choose a tag to compare
@mobicham mobicham released this 01 Mar 10:50
· 270 commits to master since this release
0.1.5
18af5e3

HQQ v0.1.5

New features

  • Added support for multi-gpu FSDP QLoRA training (#17)

Issues

  • torch.compile and the PYTORCH_COMPILE backend break with view_as_float=True. No known solution for the moment.
  • A bit slower inference with view_as_float=True. Solution: after training, the user can revert back to in bitpacking.
Assets 2
Loading