Code

add tokenizer logs info#1731

Code

Merged

lintangsutawika merged 11 commits intoEleutherAI:mainEleutherAI/lm-evaluation-harness:mainfrom artemorloff:feature/tokenizer_loggingartemorloff/lm-evaluation-harness:feature/tokenizer_loggingCopy head branch name to clipboardJun 24, 2024

+19-1

Commits

Commits on Apr 22, 2024

• add tokenizer logs info

  artemorloff

  committed
  214cda5

  Copy full SHA for 214cda5

• add no tokenizer case

  artemorloff

  committed
  dcc779d

  Copy full SHA for dcc779d

Commits on Apr 27, 2024

• Merge branch 'main' of https://github.com/EleutherAI/lm-evaluation-harness into feature/tokenizer_logging

  artemorloff

  committed
  691b4c6

  Copy full SHA for 691b4c6

Commits on May 13, 2024

• Update lm_eval/logging_utils.py

  Show description for 98983ab
  

  artemorloff

  and

  haileyschoelkopf

  authored
  98983ab

  Copy full SHA for 98983ab

• Update lm_eval/logging_utils.py

  Show description for a04e1c9
  

  artemorloff

  and

  haileyschoelkopf

  authored
  a04e1c9

  Copy full SHA for a04e1c9

• add updates

  artemorloff

  committed
  dafefc3

  Copy full SHA for dafefc3

• Merge 'main' into feature/tokenizer_logging

  artemorloff

  committed
  5ff6cde

  Copy full SHA for 5ff6cde

Commits on May 28, 2024

• Merge remote-tracking branch 'upstream/main' into feature/tokenizer_logging

  artemorloff

  committed
  9c8fc65

  Copy full SHA for 9c8fc65

• fix conflict

  artemorloff

  committed
  e7a2852

  Copy full SHA for e7a2852

Commits on Jun 3, 2024

• Merge remote-tracking branch 'upstream/main' into feature/tokenizer_logging

  artemorloff

  committed
  374933a

  Copy full SHA for 374933a

Commits on Jun 5, 2024

• Merge remote-tracking branch 'upstream/main' into feature/tokenizer_logging

  artemorloff

  committed
  a3a454a

  Copy full SHA for a3a454a