Skip to content

0.30.0
Compare
Choose a tag to compare
@matatonic matatonic released this 13 Sep 17:56
· 33 commits to main since this release
0.30.0
c615dcc

Recent updates

Version 0.30.0

  • new model support: mistralai/Pixtral-12B-2409 (no streaming yet, no quants yet)
  • new model support: LMMs-Lab's llava-onevision-qwen2, 0.5b, 7b and 72b (72b untested, 4bit support doesn't seem to work properly yet)
  • Update moondream2 to version 2024-08-26
  • Performance fixed: idefics2-8b-AWQ, idefics2-8b-chatty-AWQ
Assets 2
Loading