Skip to content

Actions: huggingface/lighteval

Actions

Tests

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
tests.yaml
1,773 workflow runs
1,773 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Hotfix for litellm judge Tests #1992: Pull request #490 synchronize by JoelNiklaus
January 7, 2025 15:17 37m 41s JoelNiklaus:fix-litellm-judge
JoelNiklaus:fix-litellm-judge
January 7, 2025 15:17 37m 41s
Implemented the possibility to load predictions from details files and continue evaluating from there Tests #1991: Pull request #488 synchronize by JoelNiklaus
January 7, 2025 15:00 Action required JoelNiklaus:load-details
JoelNiklaus:load-details
January 7, 2025 15:00 Action required
Hotfix for litellm judge Tests #1990: Pull request #490 synchronize by JoelNiklaus
January 7, 2025 14:57 42m 9s JoelNiklaus:fix-litellm-judge
JoelNiklaus:fix-litellm-judge
January 7, 2025 14:57 42m 9s
Fix T_co import bug Tests #1989: Pull request #484 synchronize by gucci-j
January 7, 2025 13:51 38m 30s gucci-j:fix-tco
gucci-j:fix-tco
January 7, 2025 13:51 38m 30s
feat: add JGLUE tasks Tests #1987: Pull request #469 synchronize by ryan-minato
January 7, 2025 09:10 Action required ryan-minato:jglue
ryan-minato:jglue
January 7, 2025 09:10 Action required
feat: add JGLUE tasks Tests #1986: Pull request #469 synchronize by ryan-minato
January 7, 2025 09:08 Action required ryan-minato:jglue
ryan-minato:jglue
January 7, 2025 09:08 Action required
Made litellm judge backend more robust. (#485) Tests #1985: Commit fdb12f4 pushed by clefourrier
January 7, 2025 08:24 37m 57s main
main
January 7, 2025 08:24 37m 57s
Fix issue with encodings for together models. (#483) Tests #1984: Commit 2073a29 pushed by clefourrier
January 7, 2025 08:23 37m 41s main
main
January 7, 2025 08:23 37m 41s
Implemented the possibility to load predictions from details files and continue evaluating from there Tests #1983: Pull request #488 synchronize by JoelNiklaus
January 7, 2025 06:11 38m 18s JoelNiklaus:load-details
JoelNiklaus:load-details
January 7, 2025 06:11 38m 18s
Add swiss legal evals as new community tasks Tests #1982: Pull request #389 synchronize by JoelNiklaus
January 7, 2025 04:30 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 7, 2025 04:30 Action required
Added cache for openai models. Tests #1981: Pull request #435 synchronize by JoelNiklaus
January 7, 2025 04:30 Action required JoelNiklaus:add-openai-cache
JoelNiklaus:add-openai-cache
January 7, 2025 04:30 Action required
Added custom model inference. Tests #1980: Pull request #437 synchronize by JoelNiklaus
January 7, 2025 04:29 Action required JoelNiklaus:add-custom-model
JoelNiklaus:add-custom-model
January 7, 2025 04:29 Action required
Fix issue with encodings for together models. Tests #1979: Pull request #483 synchronize by JoelNiklaus
January 7, 2025 04:26 40m 34s JoelNiklaus:fix-encoding-issue
JoelNiklaus:fix-encoding-issue
January 7, 2025 04:26 40m 34s
Made litellm judge backend more robust. Tests #1978: Pull request #485 synchronize by JoelNiklaus
January 7, 2025 04:26 37m 59s JoelNiklaus:fix-litellm-judge
JoelNiklaus:fix-litellm-judge
January 7, 2025 04:26 37m 59s
Implemented the possibility to load predictions from details files and continue evaluating from there Tests #1977: Pull request #488 opened by JoelNiklaus
January 7, 2025 04:23 Action required JoelNiklaus:load-details
JoelNiklaus:load-details
January 7, 2025 04:23 Action required
feat: add asian language support to CorpusLevelTranslationMetric Tests #1975: Pull request #479 synchronize by ryan-minato
January 7, 2025 00:25 2m 55s ryan-minato:feat/asian-lang-translate-metic
ryan-minato:feat/asian-lang-translate-metic
January 7, 2025 00:25 2m 55s
Update README.md (#486) Tests #1974: Commit f6fee3a pushed by clefourrier
January 6, 2025 12:45 39m 6s main
main
January 6, 2025 12:45 39m 6s
fix doc links in readme Tests #1973: Pull request #486 opened by NathanHB
January 6, 2025 11:31 37m 54s NathanHB-patch-1
NathanHB-patch-1
January 6, 2025 11:31 37m 54s
Add swiss legal evals as new community tasks Tests #1969: Pull request #389 synchronize by JoelNiklaus
January 4, 2025 10:18 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 4, 2025 10:18 Action required
Tiny improvements to endpoint_model.py, base_model.py,... (#219) Tests #1968: Commit 452e031 pushed by clefourrier
January 3, 2025 17:22 39m 12s main
main
January 3, 2025 17:22 39m 12s
Tiny improvements to endpoint_model.py, base_model.py,... Tests #1967: Pull request #219 synchronize by sadra-barikbin
January 3, 2025 15:33 37m 32s sadra-barikbin:small-improvement-in-models
sadra-barikbin:small-improvement-in-models
January 3, 2025 15:33 37m 32s
Fix T_co import bug Tests #1966: Pull request #484 opened by gucci-j
January 3, 2025 15:03 38m 48s gucci-j:fix-tco
gucci-j:fix-tco
January 3, 2025 15:03 38m 48s
Release: v0.7.0 Tests #1965: Commit 657978d pushed by NathanHB
January 3, 2025 14:02 38m 6s v0.7-release
v0.7-release
January 3, 2025 14:02 38m 6s
Add swiss legal evals as new community tasks Tests #1964: Pull request #389 synchronize by JoelNiklaus
January 3, 2025 11:55 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 3, 2025 11:55 Action required
Add swiss legal evals as new community tasks Tests #1963: Pull request #389 synchronize by JoelNiklaus
January 3, 2025 11:11 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 3, 2025 11:11 Action required