Skip to content

Issues: embeddings-benchmark/mteb

Merge v2.0.0: Overview issue
#1791 opened Jan 13, 2025 by KennethEnevoldsen
Open 2
Overview: Leaderboard release
#1867 opened Jan 24, 2025 by x-tabdeveloping
Open 26
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

172 Open 563 Closed
172 Open 563 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Leaderboard: Gradio Sidebars for better UI enhancement New feature or request leaderboard issues related to the leaderboard
#1988 opened Feb 5, 2025 by Muennighoff
Leaderboard: FAQ md file on transition leaderboard issues related to the leaderboard
#1987 opened Feb 5, 2025 by Muennighoff
@KennethEnevoldsen
Leaderboard: Add more explainers leaderboard issues related to the leaderboard
#1986 opened Feb 5, 2025 by Muennighoff
Leaderboard: Order benchmarks alphabetically leaderboard issues related to the leaderboard
#1984 opened Feb 5, 2025 by Muennighoff
Leaderboard: Cache more results enhancement New feature or request leaderboard issues related to the leaderboard
#1983 opened Feb 5, 2025 by Muennighoff
7
Leaderboard: FollowIR gone leaderboard issues related to the leaderboard
#1982 opened Feb 5, 2025 by Muennighoff
SONAR results gone / Add SONAR implementation
#1981 opened Feb 5, 2025 by Muennighoff
2
Leaderboard: CoIR seems broken leaderboard issues related to the leaderboard
#1980 opened Feb 5, 2025 by Muennighoff
1
Leaderboard: voyage-law gone leaderboard issues related to the leaderboard
#1979 opened Feb 5, 2025 by Muennighoff
3
Leaderboard: BRIGHT Long gone leaderboard issues related to the leaderboard
#1978 opened Feb 5, 2025 by Muennighoff
Leaderboard: Many results on BRIGHT missing leaderboard issues related to the leaderboard
#1977 opened Feb 5, 2025 by Muennighoff
Leaderboard: OpenAI results gone? leaderboard issues related to the leaderboard
#1976 opened Feb 5, 2025 by Muennighoff
[v2] MIEB classes with duplicate names v2 Issues and PRs related to `v2` branch
#1974 opened Feb 5, 2025 by Samoed
2
Reduce start-up time for the leaderboard enhancement New feature or request leaderboard issues related to the leaderboard
#1972 opened Feb 5, 2025 by KennethEnevoldsen
2 tasks
2
Ensure that descriptive stats are computed for all tasks enhancement New feature or request
#1970 opened Feb 5, 2025 by KennethEnevoldsen
2 tasks
1
Make some dependencies optional
#1966 opened Feb 5, 2025 by x-tabdeveloping
3
Tests for MIEB evaluators mieb The image extension of MTEB v2 Issues and PRs related to `v2` branch
#1955 opened Feb 4, 2025 by Muennighoff
Leaderboard model size toggle bug bug Something isn't working leaderboard issues related to the leaderboard
#1954 opened Feb 4, 2025 by Muennighoff
1
@KennethEnevoldsen
14
Zero-shot default enhancement New feature or request leaderboard issues related to the leaderboard
#1953 opened Feb 4, 2025 by Muennighoff
3
Add filtering for modality to mteb.get_task
#1951 opened Feb 4, 2025 by KennethEnevoldsen
[v2] Integrate cde models v2 Issues and PRs related to `v2` branch
#1946 opened Feb 3, 2025 by Samoed v2.0.0
Evaluation on Classfiication with modernbert contains NaN.
#1943 opened Feb 3, 2025 by JunyiZhu-AI
3
Integrate SuperGLUE new dataset Issues related to adding a new task or dataset
#1937 opened Feb 2, 2025 by Samoed
[v2] Reupload BEIR-PL v2 Issues and PRs related to `v2` branch
#1936 opened Feb 2, 2025 by Samoed v2.0.0
[Leaderboard] Autocalculate memory usage in model meta enhancement New feature or request leaderboard issues related to the leaderboard
#1935 opened Feb 2, 2025 by Samoed
2
ProTip! What’s not been updated in a month: updated:<2025-01-06.