0.32.0

Recent updates

Version 0.32.0

• new model support: From AIDC-AI, Ovis1.5-Gemma2-9B and Ovis1.5-Llama3-8B
• new model support: omlab/omchat-v2.0-13B-single-beta_hf

0.31.0

Recent updates

Version 0.31.0

• new model support: Qwen/Qwen2-VL family of models (video untested, GPTQ not working yet, but AWQ and BF16 are fine)
• transformers from git
• Regression: THUD/glm-4v-9b broken in this release (re: transformers)

0.30.0

Recent updates

Version 0.30.0

• new model support: mistralai/Pixtral-12B-2409 (no streaming yet, no quants yet)
• new model support: LMMs-Lab's llava-onevision-qwen2, 0.5b, 7b and 72b (72b untested, 4bit support doesn't seem to work properly yet)
• Update moondream2 to version 2024-08-26
• Performance fixed: idefics2-8b-AWQ, idefics2-8b-chatty-AWQ

0.29.0

Recent updates

Version 0.29.0

• new model support: fancyfeast/joy-caption-pre-alpha (caption only, depends on Meta-Llama-3.1-8b [authorization required], --load-in-4bit avoids this dependency)
• new model support: MiniCPM-V-2_6 (video not supported yet)
• new model support: microsoft/Phi-3.5-vision-instruct (worked without any changes)
• new model support: Salesforce/xgen-mm-phi3-mini-instruct-r-v1.5 family of models: singleimage, dpo, interleave
• library updates: torch 2.4, transformers >=4.44.2
• New -alt docker image support (transformers==4.41.2, was 4.36.2)
• !!! ⚠️ WARNING ⚠️ !!! Broken in this release: MiniCPM-V, MiniCPM-V-2, llava-v1.6-mistral-7b-hf, internlm-xcomposer2* (all 4bit), dolphin-vision* (all), THUDM/cog* (all), InternVL2-4B,Mini-InternVL-Chat-4B-V1-5, falcon-11B-vlm ! ⚠️ WARNING ⚠️ !!!
• • Use version :0.28.1 or the -alt docker image for continued support of these models.
• Performance regression: idefics2-8b-AWQ, idefics2-8b-chatty-AWQ
• ⚠️ DEPRECATED MODELS: YanweiLi/MGM*, Moondream1 (use the -alt:0.28.1 image for support of these models)
• unpin MiniCPM-Llama3-V-2_5, glm-v-9B revisions

0.28.1

Version 0.28.1

• Update moondream2 support to 2024-07-23
• Pin openbmb/MiniCPM-Llama3-V-2_5 revision

0.28.0

Recent updates

Version 0.28.0

• new model support: internlm-xcomposer2d5-7b
• new model support: dolphin-vision-7b (currently KeyError: 'bunny-qwen')
• Pin glm-v-9B revision until we support transformers 4.42

0.27.1

Version 0.27.1

• new model support: qnguyen3/nanoLLaVA-1.5
• Complete support for chat without images (using placeholder images where required, 1x1 clear or 8x8 black as necessary)
• Require transformers==4.41.2 (4.42 breaks many models)
• Fixes #5

0.27.0

Recent updates

Version 0.27.0

• new model support: OpenGVLab/InternVL2 series of models (1B, 2B, 4B, 8B*, 26B*, 40B*) - *(current top open source models)

0.26.0

Version 0.26.0

• new model support: cognitivecomputations/dolphin-vision-72b

0.25.1

Version 0.25.1

• Fix typo in vision.sample.env