Error during inference with SmolVLM-500M-Instruct-8bit

[laclouis5]

During inference of SmolVLM-500M-Instruct-8bit the following error occurs:

Failed to generate AI response
Error rendering prompt with jinja template: Error: Expected iterable type in for loop: got StringValue

To Reproduce

Plateform: MacBool Pro M1 Pro
OS: macOS 15.1.1
LM Studio: 0.3.8
MLX runtime: 0.2.1

Model: SmolVLM-500M-Instruct-8bit
Seed: 42
Context length: 4096
Prompt: "What is this paper about?"
Image: Google Drive link

The error occurs in the middle of the response:

This paper proposes a new framework for arbitrary-scale super-resolution at an arbitrary resolution.<end_of_utterance>

[neilmehta24]

SmolVLM is a model we haven't explicitly added support for yet.