Skip to content

Actions: huggingface/lighteval

Actions

Tests

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
tests.yaml
1,425 workflow run results
1,425 workflow run results

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Allow AdapterModels to have custom tokens Tests #1546: Pull request #306 synchronize by mapmeld
November 25, 2024 01:39 38m 7s mapmeld:resize
mapmeld:resize
November 25, 2024 01:39 38m 7s
Tiny improvements to endpoint_model.py, base_model.py,... Tests #1544: Pull request #219 synchronize by sadra-barikbin
November 24, 2024 03:57 38m 17s sadra-barikbin:small-improvement-in-models
sadra-barikbin:small-improvement-in-models
November 24, 2024 03:57 38m 17s
Add new Arabic benchmarks (5) and enhance existing tasks Tests #1542: Pull request #372 synchronize by NathanHB
November 22, 2024 14:47 38m 2s alielfilali01:main
alielfilali01:main
November 22, 2024 14:47 38m 2s
Fixes an error with getting the golds from the formatted_docs. Tests #1540: Pull request #388 synchronize by JoelNiklaus
November 22, 2024 14:00 39m 51s JoelNiklaus:fix_golds_llm_judge
JoelNiklaus:fix_golds_llm_judge
November 22, 2024 14:00 39m 51s
Considering the case empty request list is given to base model (#250) Tests #1538: Commit 2c9bf97 pushed by clefourrier
November 22, 2024 12:36 38m 32s main
main
November 22, 2024 12:36 38m 32s
Considering the case empty request list is given to base model Tests #1537: Pull request #250 synchronize by NathanHB
November 22, 2024 11:47 37m 55s sadra-barikbin:fix-empty-input-to-base-model
sadra-barikbin:fix-empty-input-to-base-model
November 22, 2024 11:47 37m 55s
Considering the case empty request list is given to base model Tests #1536: Pull request #250 synchronize by NathanHB
November 22, 2024 11:46 37m 25s sadra-barikbin:fix-empty-input-to-base-model
sadra-barikbin:fix-empty-input-to-base-model
November 22, 2024 11:46 37m 25s
Fix splitting for generative tasks Tests #1535: Pull request #400 synchronize by clefourrier
November 22, 2024 11:43 37m 11s nathan-fix-splits
nathan-fix-splits
November 22, 2024 11:43 37m 11s
Allowing a single prompt to use several formats for one eval (#398) Tests #1534: Commit 24d5feb pushed by clefourrier
November 22, 2024 11:42 37m 11s main
main
November 22, 2024 11:42 37m 11s
Considering the case empty request list is given to base model Tests #1533: Pull request #250 synchronize by clefourrier
November 22, 2024 09:38 39m 43s sadra-barikbin:fix-empty-input-to-base-model
sadra-barikbin:fix-empty-input-to-base-model
November 22, 2024 09:38 39m 43s
Allowing a single prompt to use several formats for one eval. Tests #1532: Pull request #398 synchronize by clefourrier
November 22, 2024 09:38 36m 48s use_several_formats
use_several_formats
November 22, 2024 09:38 36m 48s
Update instance type/size in endpoint model_config example (#401) Tests #1528: Commit 3744fe2 pushed by clefourrier
November 21, 2024 10:41 37m 11s main
main
November 21, 2024 10:41 37m 11s
Update instance type/size in endpoint model_config example Tests #1527: Pull request #401 synchronize by albertvillanova
November 21, 2024 09:15 37m 22s albertvillanova:patch-1
albertvillanova:patch-1
November 21, 2024 09:15 37m 22s
Update instance type/size in endpoint model_config example Tests #1526: Pull request #401 opened by albertvillanova
November 21, 2024 08:33 37m 55s albertvillanova:patch-1
albertvillanova:patch-1
November 21, 2024 08:33 37m 55s
Fix splitting for generative tasks Tests #1525: Pull request #400 synchronize by clefourrier
November 20, 2024 14:16 38m 28s nathan-fix-splits
nathan-fix-splits
November 20, 2024 14:16 38m 28s
Fix splitting for generative tasks Tests #1524: Pull request #400 opened by NathanHB
November 20, 2024 12:53 37m 30s nathan-fix-splits
nathan-fix-splits
November 20, 2024 12:53 37m 30s
Pr sadra (#393) Tests #1522: Commit e25af7b pushed by clefourrier
November 20, 2024 10:49 38m 5s main
main
November 20, 2024 10:49 38m 5s
Pr sadra Tests #1519: Pull request #393 synchronize by clefourrier
November 20, 2024 10:08 38m 46s pr_sadra
pr_sadra
November 20, 2024 10:08 38m 46s
fix repeated cleanup (#399) Tests #1518: Commit 85c0d9f pushed by clefourrier
November 20, 2024 10:08 37m 4s main
main
November 20, 2024 10:08 37m 4s
Quickfix: repeated vllm model cleanup when data_parallel_size>1 Tests #1517: Pull request #399 synchronize by NathanHB
November 19, 2024 14:52 38m 22s anton-l:vllm_cleanup
anton-l:vllm_cleanup
November 19, 2024 14:52 38m 22s
Quickfix: repeated vllm model cleanup when data_parallel_size>1 Tests #1516: Pull request #399 opened by anton-l
November 19, 2024 14:43 2m 46s anton-l:vllm_cleanup
anton-l:vllm_cleanup
November 19, 2024 14:43 2m 46s
Allowing a single prompt to use several formats for one eval. Tests #1513: Pull request #398 synchronize by clefourrier
November 19, 2024 13:48 37m 17s use_several_formats
use_several_formats
November 19, 2024 13:48 37m 17s
Allowing a single prompt to use several formats for one eval. Tests #1512: Pull request #398 opened by clefourrier
November 19, 2024 13:41 36m 41s use_several_formats
use_several_formats
November 19, 2024 13:41 36m 41s
Considering the case empty request list is given to base model Tests #1510: Pull request #250 synchronize by NathanHB
November 19, 2024 13:15 38m 25s sadra-barikbin:fix-empty-input-to-base-model
sadra-barikbin:fix-empty-input-to-base-model
November 19, 2024 13:15 38m 25s
Pr sadra Tests #1508: Pull request #393 synchronize by NathanHB
November 19, 2024 12:50 38m 48s pr_sadra
pr_sadra
November 19, 2024 12:50 38m 48s