Skip to content

[Bug] Phi-3.5-vision Cannot find parameter in cache #79

@ghafran

Description

@ghafran

Bug Description

When using Phi-3.5-vision model, we get this error with all prompt.

sw.js:64 [FATAL] /Users/cfruan/Documents/tvm/web/../src/runtime/relax_vm/ndarray_cache_support.cc:333: ValueError: Cannot find parameter in cache: vision_embed_tokens.img_processor.vision_model.embeddings.position_embedding.q_weight

Steps to Reproduce

Select Phi-3.5-vision-instruct-q4f32_1-MLC Model
input anything, and get the error

Expected Behavior

Image

Screenshots

No response

LLM Model ID

No response

Desktop Browser

No response

Desktop Browser Version

No response

Smartphone OS

No response

Smartphone Browser

No response

Smartphone Browser Version

No response

Additional Logs

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions