-
Notifications
You must be signed in to change notification settings - Fork 155
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Bug Description
When using Phi-3.5-vision model, we get this error with all prompt.
sw.js:64 [FATAL] /Users/cfruan/Documents/tvm/web/../src/runtime/relax_vm/ndarray_cache_support.cc:333: ValueError: Cannot find parameter in cache: vision_embed_tokens.img_processor.vision_model.embeddings.position_embedding.q_weight
Steps to Reproduce
Select Phi-3.5-vision-instruct-q4f32_1-MLC Model
input anything, and get the error
Expected Behavior

Screenshots
No response
LLM Model ID
No response
Desktop Browser
No response
Desktop Browser Version
No response
Smartphone OS
No response
Smartphone Browser
No response
Smartphone Browser Version
No response
Additional Logs
No response
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working