Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Experiment with more recent static embeddings #178

Open
kermitt2 opened this issue Jan 16, 2025 · 1 comment
Open

Experiment with more recent static embeddings #178

kermitt2 opened this issue Jan 16, 2025 · 1 comment

Comments

@kermitt2
Copy link
Owner

Complementary to the slow transformer embeddings, we currently use very old static embeddings when using RNN. More recent static embeddings are available and suggest higher performance (quality and speed), see below:

Image

(from https://huggingface.co/blog/static-embeddings)

@lfoppiano
Copy link
Collaborator

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants