Skip to content

0.29.0
Compare
Choose a tag to compare
@matatonic matatonic released this 26 Aug 22:34
· 37 commits to main since this release
0.29.0
469d414

Recent updates

Version 0.29.0

  • new model support: fancyfeast/joy-caption-pre-alpha (caption only, depends on Meta-Llama-3.1-8b [authorization required], --load-in-4bit avoids this dependency)
  • new model support: MiniCPM-V-2_6 (video not supported yet)
  • new model support: microsoft/Phi-3.5-vision-instruct (worked without any changes)
  • new model support: Salesforce/xgen-mm-phi3-mini-instruct-r-v1.5 family of models: singleimage, dpo, interleave
  • library updates: torch 2.4, transformers >=4.44.2
  • New -alt docker image support (transformers==4.41.2, was 4.36.2)
  • !!! ⚠️ WARNING ⚠️ !!! Broken in this release: MiniCPM-V, MiniCPM-V-2, llava-v1.6-mistral-7b-hf, internlm-xcomposer2* (all 4bit), dolphin-vision* (all), THUDM/cog* (all), InternVL2-4B,Mini-InternVL-Chat-4B-V1-5, falcon-11B-vlm ! ⚠️ WARNING ⚠️ !!!
    • Use version :0.28.1 or the -alt docker image for continued support of these models.
  • Performance regression: idefics2-8b-AWQ, idefics2-8b-chatty-AWQ
  • ⚠️ DEPRECATED MODELS: YanweiLi/MGM*, Moondream1 (use the -alt:0.28.1 image for support of these models)
  • unpin MiniCPM-Llama3-V-2_5, glm-v-9B revisions
Assets 2
Loading