Skip to content

Actions: huggingface/lighteval

Actions

Quality

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
quality.yaml
1,708 workflow run results
1,708 workflow run results

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Support custom results/details push to hub Quality #1895: Pull request #457 synchronize by albertvillanova
December 20, 2024 09:11 1m 59s albertvillanova:custom-results-push-to-hub
albertvillanova:custom-results-push-to-hub
December 20, 2024 09:11 1m 59s
Use config dict in TaskConfigLogger for easier serialization Quality #1894: Pull request #454 synchronize by albertvillanova
December 20, 2024 09:10 2m 8s albertvillanova:task-config-logger
albertvillanova:task-config-logger
December 20, 2024 09:10 2m 8s
Fix warning about precedence of custom tasks over default ones in registry Quality #1893: Pull request #466 synchronize by albertvillanova
December 20, 2024 07:58 2m 22s albertvillanova:fix-task-registry
albertvillanova:fix-task-registry
December 20, 2024 07:58 2m 22s
Fix warning about precedence of custom tasks over default ones in registry Quality #1892: Pull request #466 synchronize by albertvillanova
December 20, 2024 07:57 2m 10s albertvillanova:fix-task-registry
albertvillanova:fix-task-registry
December 20, 2024 07:57 2m 10s
Add Doc Strings to Config Files Quality #1891: Pull request #465 synchronize by ParagEkbote
December 20, 2024 07:48 Action required ParagEkbote:Document-Custom-Model-Files
ParagEkbote:Document-Custom-Model-Files
December 20, 2024 07:48 Action required
feat: add JGLUE tasks Quality #1890: Pull request #469 synchronize by ryan-minato
December 19, 2024 16:15 2m 9s ryan-minato:jglue
ryan-minato:jglue
December 19, 2024 16:15 2m 9s
feat: add JGLUE tasks Quality #1889: Pull request #469 opened by ryan-minato
December 19, 2024 16:15 Action required ryan-minato:jglue
ryan-minato:jglue
December 19, 2024 16:15 Action required
Added custom model inference. Quality #1888: Pull request #437 synchronize by JoelNiklaus
December 19, 2024 16:10 Action required JoelNiklaus:add-custom-model
JoelNiklaus:add-custom-model
December 19, 2024 16:10 Action required
Checkout PR branches with a merge commit for CI tests Quality #1887: Pull request #468 synchronize by albertvillanova
December 19, 2024 15:56 2m 12s albertvillanova:ci-sync-pr-with-main
albertvillanova:ci-sync-pr-with-main
December 19, 2024 15:56 2m 12s
Checkout PR branches with a merge commit for CI tests Quality #1886: Pull request #468 opened by albertvillanova
December 19, 2024 15:16 2m 9s albertvillanova:ci-sync-pr-with-main
albertvillanova:ci-sync-pr-with-main
December 19, 2024 15:16 2m 9s
Remove unnecessary deepcopy in evaluation_tracker (#459) Quality #1885: Commit a1c610d pushed by albertvillanova
December 19, 2024 15:03 2m 11s main
main
December 19, 2024 15:03 2m 11s
Remove unnecessary deepcopy in evaluation_tracker Quality #1884: Pull request #459 synchronize by albertvillanova
December 19, 2024 14:22 2m 10s albertvillanova-patch-1
albertvillanova-patch-1
December 19, 2024 14:22 2m 10s
Add litellm inference Quality #1883: Pull request #385 synchronize by NathanHB
December 19, 2024 14:17 3m 6s JoelNiklaus:add_litellm_inference
JoelNiklaus:add_litellm_inference
December 19, 2024 14:17 3m 6s
Add litellm inference Quality #1882: Pull request #385 synchronize by NathanHB
December 19, 2024 14:11 2m 17s JoelNiklaus:add_litellm_inference
JoelNiklaus:add_litellm_inference
December 19, 2024 14:11 2m 17s
Fix warning about precedence of custom tasks over default ones in registry Quality #1880: Pull request #466 synchronize by albertvillanova
December 19, 2024 13:56 2m 6s albertvillanova:fix-task-registry
albertvillanova:fix-task-registry
December 19, 2024 13:56 2m 6s
Add EvaluationTracker to docs and fix its docstring (#464) Quality #1879: Commit 988fa94 pushed by albertvillanova
December 19, 2024 13:55 2m 8s main
main
December 19, 2024 13:55 2m 8s
Added custom model inference. Quality #1878: Pull request #437 synchronize by JoelNiklaus
December 19, 2024 13:28 Action required JoelNiklaus:add-custom-model
JoelNiklaus:add-custom-model
December 19, 2024 13:28 Action required
Add litellm inference Quality #1877: Pull request #385 synchronize by NathanHB
December 19, 2024 12:52 2m 5s JoelNiklaus:add_litellm_inference
JoelNiklaus:add_litellm_inference
December 19, 2024 12:52 2m 5s
Update arabic_evals.py: Fix custom arabic tasks [2nd attempt] Quality #1876: Pull request #444 synchronize by NathanHB
December 19, 2024 12:41 2m 5s alielfilali01:main
alielfilali01:main
December 19, 2024 12:41 2m 5s
Add EvaluationTracker to docs and fix its docstring Quality #1875: Pull request #464 synchronize by NathanHB
December 19, 2024 12:38 2m 4s albertvillanova:docstring-public
albertvillanova:docstring-public
December 19, 2024 12:38 2m 4s
Remove unnecessary deepcopy in evaluation_tracker Quality #1874: Pull request #459 synchronize by NathanHB
December 19, 2024 12:34 2m 4s albertvillanova-patch-1
albertvillanova-patch-1
December 19, 2024 12:34 2m 4s
fix: LightevalTaskConfig.stop_sequence attribute Quality #1873: Pull request #463 synchronize by NathanHB
December 19, 2024 12:32 2m 12s ryan-minato:fix/lighteval-task-config
ryan-minato:fix/lighteval-task-config
December 19, 2024 12:32 2m 12s
fix: CACHE_DIR Default Value in Accelerate Pipeline (#461) Quality #1872: Commit c45e3c8 pushed by NathanHB
December 19, 2024 12:31 2m 13s main
main
December 19, 2024 12:31 2m 13s
Fix warning about precedence of custom tasks over default ones in registry Quality #1871: Pull request #466 opened by albertvillanova
December 19, 2024 11:48 2m 9s albertvillanova:fix-task-registry
albertvillanova:fix-task-registry
December 19, 2024 11:48 2m 9s
Add Doc Strings to Config Files Quality #1870: Pull request #465 opened by ParagEkbote
December 19, 2024 10:24 Action required ParagEkbote:Document-Custom-Model-Files
ParagEkbote:Document-Custom-Model-Files
December 19, 2024 10:24 Action required