Code

Add multilingual HellaSwag task#1228

Code

Merged

haileyschoelkopf merged 9 commits intoEleutherAI:mainEleutherAI/lm-evaluation-harness:mainfrom JorgeDeCorte:mainJorgeDeCorte/lm-evaluation-harness:mainCopy head branch name to clipboardJan 5, 2024

+276-3

Commits

Commits on Dec 29, 2023

• add hellaswag_nl

  

  JorgeDeCorte

  committed
  1a376e3

  Copy full SHA for 1a376e3

Commits on Dec 30, 2023

• add other languages and update readme to hellaswag

  

  JorgeDeCorte

  committed
  e1ea0c6

  Copy full SHA for e1ea0c6

• refactor as new task

  

  JorgeDeCorte

  committed
  057f71b

  Copy full SHA for 057f71b

• update readme

  

  JorgeDeCorte

  committed
  1824381

  Copy full SHA for 1824381

Commits on Dec 31, 2023

• add endline to yaml files and readme.md

  JorgeDeCorte

  committed
  84548ce

  Copy full SHA for 84548ce

Commits on Jan 3, 2024

• add group, change folder location and update yaml file

  JorgeDeCorte

  committed
  357db09

  Copy full SHA for 357db09

Commits on Jan 4, 2024

• rename default hellaswag yaml file

  JorgeDeCorte

  committed
  9191490

  Copy full SHA for 9191490

Commits on Jan 5, 2024

• fix whitespace error in some labels

  haileyschoelkopf

  authored
  09225c7

  Copy full SHA for 09225c7

• downgrade log level of whitespace checking

  haileyschoelkopf

  authored
  98d72d5

  Copy full SHA for 98d72d5