Code

Alternative evals#675

Code

Open

AkshitaB wants to merge 15 commits intomainallenai/OLMo:mainfrom better-evalallenai/OLMo:better-evalCopy head branch name to clipboard

+350-8

Commits

Commits on Jul 23, 2024

• big and clunky eval from train

  AkshitaB

  committed
  99079f7

  Copy full SHA for 99079f7

• make it a classmethod

  AkshitaB

  committed
  bc6b43c

  Copy full SHA for bc6b43c

• simplify script

  AkshitaB

  committed
  8312a05

  Copy full SHA for 8312a05

• remove temporary code

  AkshitaB

  committed
  4282676

  Copy full SHA for 4282676

• basic algebra

  AkshitaB

  committed
  370439f

  Copy full SHA for 370439f

• add basic algebra to cache

  AkshitaB

  committed
  cea1a23

  Copy full SHA for cea1a23

Commits on Jul 26, 2024

• add as downstream task in ladder

  AkshitaB

  committed
  75c4780

  Copy full SHA for 75c4780

• more cluster options

  AkshitaB

  committed
  b0574fc

  Copy full SHA for b0574fc

• updated priority

  AkshitaB

  committed
  cc786b4

  Copy full SHA for cc786b4

• use my key instead

  AkshitaB

  committed
  fbe0263

  Copy full SHA for fbe0263

• update secrets

  AkshitaB

  committed
  5974ea0

  Copy full SHA for 5974ea0

• priority

  AkshitaB

  committed
  2c11e2e

  Copy full SHA for 2c11e2e

• new beaker image

  AkshitaB

  committed
  b030309

  Copy full SHA for b030309

Commits on Sep 20, 2024

• Merge branch 'main' into better-eval

  AkshitaB

  authored
  e8b6eb1

  Copy full SHA for e8b6eb1

• update changelog

  AkshitaB

  committed
  6e64ee3

  Copy full SHA for 6e64ee3