Skip to content

Actions: huggingface/lighteval

Actions

Quality

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
quality.yaml
822 workflow run results
822 workflow run results

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Quantization related issues Quality #807: Pull request #224 opened by clefourrier
July 11, 2024 15:03 2m 19s clem_bnb_gptq_config_bug
clem_bnb_gptq_config_bug
July 11, 2024 15:03 2m 19s
adds llm as judge using transformers Quality #806: Pull request #223 opened by NathanHB
July 11, 2024 12:03 4m 54s nathan-add-judge-transformers
nathan-add-judge-transformers
July 11, 2024 12:03 4m 54s
Make evaluator invariant of input request type order Quality #805: Pull request #215 synchronize by clefourrier
July 11, 2024 12:02 2m 54s sadra-barikbin:Fix-request-type-order-in-evaluator
sadra-barikbin:Fix-request-type-order-in-evaluator
July 11, 2024 12:02 2m 54s
Fixing PIQA implementation Quality #804: Pull request #222 opened by clefourrier
July 11, 2024 12:00 2m 43s piqa_edits
piqa_edits
July 11, 2024 12:00 2m 43s
Transformers model as Judge Quality #803: Pull request #174 synchronize by NathanHB
July 11, 2024 11:45 2m 13s anilaltuner:main
anilaltuner:main
July 11, 2024 11:45 2m 13s
Data split depending on eval params (#169) Quality #802: Commit 66e6aae pushed by NathanHB
July 11, 2024 11:16 2m 21s main
main
July 11, 2024 11:16 2m 21s
launch lighteval using lighteval --args Quality #801: Pull request #152 synchronize by NathanHB
July 11, 2024 11:09 2m 34s nathan-add-cli-tool
nathan-add-cli-tool
July 11, 2024 11:09 2m 34s
launch lighteval using lighteval --args Quality #800: Pull request #152 synchronize by NathanHB
July 11, 2024 10:34 2m 11s nathan-add-cli-tool
nathan-add-cli-tool
July 11, 2024 10:34 2m 11s
Data split depending on eval params Quality #798: Pull request #169 synchronize by clefourrier
July 11, 2024 08:17 2m 37s data_split_depending_on_eval_params
data_split_depending_on_eval_params
July 11, 2024 08:17 2m 37s
Fix _init_max_length in base_model.py Quality #797: Pull request #185 synchronize by NathanHB
July 10, 2024 14:51 2m 21s gucci-j:dev-gucci
gucci-j:dev-gucci
July 10, 2024 14:51 2m 21s
Data split depending on eval params Quality #796: Pull request #169 synchronize by clefourrier
July 10, 2024 14:51 2m 28s data_split_depending_on_eval_params
data_split_depending_on_eval_params
July 10, 2024 14:51 2m 28s
Data split depending on eval params Quality #795: Pull request #169 synchronize by clefourrier
July 9, 2024 13:45 2m 24s data_split_depending_on_eval_params
data_split_depending_on_eval_params
July 9, 2024 13:45 2m 24s
Ar support for MBZUAI-arabic-mmlu Quality #794: Pull request #209 synchronize by NathanHB
July 9, 2024 13:36 2m 29s bakrianoo:ar-support-ArabicMMLU
bakrianoo:ar-support-ArabicMMLU
July 9, 2024 13:36 2m 29s
Add metrics as functions Quality #793: Pull request #214 synchronize by clefourrier
July 9, 2024 13:34 2m 19s metrics_as_fn
metrics_as_fn
July 9, 2024 13:34 2m 19s
Now only uses functions for prompt definition (#213) Quality #792: Commit 4651531 pushed by clefourrier
July 9, 2024 13:29 2m 19s main
main
July 9, 2024 13:29 2m 19s
Now only uses functions for prompt definition Quality #791: Pull request #213 synchronize by clefourrier
July 9, 2024 12:49 2m 13s hynek_function
hynek_function
July 9, 2024 12:49 2m 13s
A small improvement in metrics_sample.py::ROUGE Quality #790: Pull request #217 synchronize by NathanHB
July 9, 2024 12:47 2m 16s sadra-barikbin:small-improvement-in-rouge
sadra-barikbin:small-improvement-in-rouge
July 9, 2024 12:47 2m 16s
Use only dataclasses for task init (#212) Quality #789: Commit 3aaec22 pushed by clefourrier
July 9, 2024 12:42 3m 36s main
main
July 9, 2024 12:42 3m 36s
Use only dataclasses for task init Quality #788: Pull request #212 synchronize by clefourrier
July 9, 2024 11:49 2m 25s simplify_task_system
simplify_task_system
July 9, 2024 11:49 2m 25s
Fix a few typos in metrics.py (#218) Quality #787: Commit 3f90950 pushed by clefourrier
July 9, 2024 11:42 3m 8s main
main
July 9, 2024 11:42 3m 8s
Use only dataclasses for task init Quality #786: Pull request #212 synchronize by NathanHB
July 9, 2024 11:07 2m 16s simplify_task_system
simplify_task_system
July 9, 2024 11:07 2m 16s
Fix a few typos in metrics.py Quality #785: Pull request #218 synchronize by clefourrier
July 9, 2024 11:01 2m 37s sadra-barikbin:fix-afew-typos-in-metrics
sadra-barikbin:fix-afew-typos-in-metrics
July 9, 2024 11:01 2m 37s
Homogeneize logging system (#150) Quality #784: Commit ac57b78 pushed by clefourrier
July 9, 2024 10:13 2m 19s main
main
July 9, 2024 10:13 2m 19s
Homogeneize logging system Quality #783: Pull request #150 synchronize by clefourrier
July 9, 2024 09:29 2m 16s clem_homogeneize_logging
clem_homogeneize_logging
July 9, 2024 09:29 2m 16s
Homogeneize logging system Quality #782: Pull request #150 synchronize by clefourrier
July 9, 2024 09:29 2m 25s clem_homogeneize_logging
clem_homogeneize_logging
July 9, 2024 09:29 2m 25s