Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

Tasks Modified

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
new_tasks.yml
1,585 workflow run results
1,585 workflow run results

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Add chat template Tasks Modified #2491: Pull request #1873 synchronize by KonradSzafer
May 29, 2024 13:54 1m 36s chat_template
chat_template
May 29, 2024 13:54 1m 36s
add arc_challenge_mt Tasks Modified #2490: Pull request #1900 opened by jonabur
May 29, 2024 07:57 2m 56s jonabur:upstream-main
jonabur:upstream-main
May 29, 2024 07:57 2m 56s
Updated vllm imports in vllm_causallms.py (#1890) Tasks Modified #2489: Commit b4cd85d pushed by haileyschoelkopf
May 28, 2024 17:40 14s main
main
May 28, 2024 17:40 14s
add tokenizer logs info Tasks Modified #2488: Pull request #1731 synchronize by artemorloff
May 28, 2024 14:49 14s artemorloff:feature/tokenizer_logging
artemorloff:feature/tokenizer_logging
May 28, 2024 14:49 14s
add tokenizer logs info Tasks Modified #2487: Pull request #1731 synchronize by artemorloff
May 28, 2024 14:27 19s artemorloff:feature/tokenizer_logging
artemorloff:feature/tokenizer_logging
May 28, 2024 14:27 19s
add context-based requests processing Tasks Modified #2486: Pull request #1571 synchronize by artemorloff
May 28, 2024 14:22 1m 40s artemorloff:feature/context_tasks
artemorloff:feature/context_tasks
May 28, 2024 14:22 1m 40s
Add dataset card when pushing to HF hub Tasks Modified #2485: Pull request #1898 opened by KonradSzafer
May 28, 2024 11:00 16s dataset_card
dataset_card
May 28, 2024 11:00 16s
Add new Lambada translations Tasks Modified #2484: Pull request #1897 opened by zafstojano
May 28, 2024 08:45 1m 47s zafstojano:lambada-new-translations
zafstojano:lambada-new-translations
May 28, 2024 08:45 1m 47s
Making hardcoded few shots compatible with the chat template mechanism Tasks Modified #2483: Pull request #1895 opened by clefourrier
May 28, 2024 07:15 8m 14s manage_few_shot
manage_few_shot
May 28, 2024 07:15 8m 14s
higher_is_better tickers in output table Tasks Modified #2482: Pull request #1893 opened by zafstojano
May 27, 2024 15:08 13s zafstojano:higher-is-better-output
zafstojano:higher-is-better-output
May 27, 2024 15:08 13s
Rename lm_eval.logging -> lm_eval.loggers (#1858) Tasks Modified #2481: Commit 0ff6ab9 pushed by haileyschoelkopf
May 26, 2024 10:54 15s main
main
May 26, 2024 10:54 15s
Updated vllm imports in vllm_causallms.py Tasks Modified #2480: Pull request #1890 synchronize by mgoin
May 25, 2024 11:19 11s mgoin:patch-2
mgoin:patch-2
May 25, 2024 11:19 11s
Updated vllm imports in vllm_causallms.py Tasks Modified #2479: Pull request #1890 opened by mgoin
May 25, 2024 11:18 13s mgoin:patch-2
mgoin:patch-2
May 25, 2024 11:18 13s
[HFLM]Add support for Ascend NPU Tasks Modified #2477: Pull request #1886 synchronize by ji-huazhong
May 25, 2024 07:10 13s ji-huazhong:npu-support
ji-huazhong:npu-support
May 25, 2024 07:10 13s
[HFLM]Add support for Ascend NPU Tasks Modified #2476: Pull request #1886 opened by ji-huazhong
May 25, 2024 07:02 17s ji-huazhong:npu-support
ji-huazhong:npu-support
May 25, 2024 07:02 17s
add NPU support for huggingface.py Tasks Modified #2475: Pull request #1787 synchronize by ji-huazhong
May 25, 2024 06:39 15s jiaqiw09:device_npu
jiaqiw09:device_npu
May 25, 2024 06:39 15s
add NPU support for huggingface.py Tasks Modified #2474: Pull request #1787 synchronize by ji-huazhong
May 25, 2024 06:33 13s jiaqiw09:device_npu
jiaqiw09:device_npu
May 25, 2024 06:33 13s
Bigbench fix (#1686) Tasks Modified #2473: Commit 78a215e pushed by haileyschoelkopf
May 24, 2024 16:00 11m 17s main
main
May 24, 2024 16:00 11m 17s
Bigbench fix Tasks Modified #2472: Pull request #1686 synchronize by haileyschoelkopf
May 24, 2024 15:59 18m 15s bigbench-fix
bigbench-fix
May 24, 2024 15:59 18m 15s
Bigbench fix Tasks Modified #2471: Pull request #1686 synchronize by haileyschoelkopf
May 24, 2024 15:59 13m 10s bigbench-fix
bigbench-fix
May 24, 2024 15:59 13m 10s
add mmlu tasks from pile-t5 (#1710) Tasks Modified #2470: Commit f2ea37e pushed by haileyschoelkopf
May 24, 2024 15:56 2m 46s main
main
May 24, 2024 15:56 2m 46s
Fix for bootstrap_iters = 0 case (#1715) (#1789) Tasks Modified #2469: Commit b043b05 pushed by haileyschoelkopf
May 24, 2024 15:37 1m 58s main
main
May 24, 2024 15:37 1m 58s
Fix Brier Score (#1847) Tasks Modified #2468: Commit 7d747ea pushed by haileyschoelkopf
May 24, 2024 15:37 1m 39s main
main
May 24, 2024 15:37 1m 39s
add mmlu tasks from pile-t5 Tasks Modified #2467: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:31 6m 21s pile-t5
pile-t5
May 24, 2024 15:31 6m 21s
add mmlu tasks from pile-t5 Tasks Modified #2466: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:31 8m 13s pile-t5
pile-t5
May 24, 2024 15:31 8m 13s