Code

Reverse weight decay#567

Code

Open

AkshitaB wants to merge 14 commits intomainallenai/OLMo:mainfrom reverse-decayallenai/OLMo:reverse-decayCopy head branch name to clipboard

+86-8

Commits

Commits on May 3, 2024

• reverse weight decay

  AkshitaB

  committed
  6240dc9

  Copy full SHA for 6240dc9

• bug fix

  AkshitaB

  committed
  0f5e28f

  Copy full SHA for 0f5e28f

• std, not norm

  AkshitaB

  committed
  b7dc57e

  Copy full SHA for b7dc57e

• right config key

  AkshitaB

  committed
  1fc07cd

  Copy full SHA for 1fc07cd

Commits on May 6, 2024

• pow, not bitwise

  AkshitaB

  committed
  4c5c4b1

  Copy full SHA for 4c5c4b1

• always compute param norm if reverse decay

  AkshitaB

  committed
  49a6f83

  Copy full SHA for 49a6f83

• only for embedding group

  AkshitaB

  committed
  9fae31a

  Copy full SHA for 9fae31a

• make mypy happy

  AkshitaB

  committed
  d6d5345

  Copy full SHA for d6d5345

• changelog

  AkshitaB

  committed
  70d12b8

  Copy full SHA for 70d12b8

• Merge branch 'main' into reverse-decay

  dirkgr

  authored
  2f8beef

  Copy full SHA for 2f8beef

• isort

  AkshitaB

  committed
  d2f6ea2

  Copy full SHA for d2f6ea2

• rename to regularize_embeddings

  AkshitaB

  committed
  717925e

  Copy full SHA for 717925e

• change docstring

  AkshitaB

  committed
  962b983

  Copy full SHA for 962b983

• update changelog

  AkshitaB

  committed
  465d143

  Copy full SHA for 465d143