Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to identify which models will work with transformers.js? #1032

Open
punkpeye opened this issue Nov 15, 2024 · 5 comments
Open

How to identify which models will work with transformers.js? #1032

punkpeye opened this issue Nov 15, 2024 · 5 comments
Labels
question Further information is requested

Comments

@punkpeye
Copy link

Question

I've tried multiple models from MTEB dashboard (e.g. jinaai/jina-embeddings-v3, jinaai/jina-embeddings-v2, dunzhang/stella_en_400M_v5), but none of them work.

It's not clear which models will work?

const generateGteSmallEmbedding = await pipeline(
  'feature-extraction',
  'dunzhang/stella_en_400M_v5',
);
@punkpeye punkpeye added the question Further information is requested label Nov 15, 2024
@xenova
Copy link
Collaborator

xenova commented Nov 16, 2024

Hi there 👋 Models that are supported by transformers.js contain the "transformers.js" tag on the Hugging Face Hub: https://huggingface.co/models?library=transformers.js&sort=downloads

image

e.g.,
image

@donicakraningrat
Copy link

How do I get existing model to work in transformers.js? What changes need to be made

@vrajshroff
Copy link

I am trying to use this model with transformers.js: pyannote/speaker-diarization-3.0. I am not sure how I can do that.

I see a similar model can be used with it: https://huggingface.co/pyannote/segmentation-3.0/tree/main. Thanks for your help!

@vrajshroff
Copy link

@xenova I posted this question here. Would love to hear from you if you have some time. Thank you!

@vishnusureshperumbavoor

How to add a huggingface model to transformers js?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

5 participants