Skip to content
This repository has been archived by the owner on May 28, 2024. It is now read-only.

Support for the Mistral based Embeddings models #132

Open
lynkz-matt-psaltis opened this issue Feb 9, 2024 · 0 comments
Open

Support for the Mistral based Embeddings models #132

lynkz-matt-psaltis opened this issue Feb 9, 2024 · 0 comments

Comments

@lynkz-matt-psaltis
Copy link

For example: https://huggingface.co/intfloat/e5-mistral-7b-instruct

Currently it looks like these models do not support the token_type_ids property which is mandatory in the embedding warmup phase: https://github.com/ray-project/ray-llm/blob/master/rayllm/backend/llm/embedding/embedding_engine.py#L112C14-L112C28

Are you open to PRs on this sort of stuff?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant