Code

[#42] pp data comm func (WIP)#47

Code

Merged

hyunwoongko merged 10 commits intomainEleutherAI/oslo:mainfrom feature/42-pp_data_comm_funcEleutherAI/oslo:feature/42-pp_data_comm_funcCopy head branch name to clipboardSep 30, 2022

+604-400

Commits

Commits on Sep 26, 2022

• support HF T5

  ohwi

  committed
  124c527

  Copy full SHA for 124c527

• Update test_pp.py

  ohwi

  committed
  f749c43

  Copy full SHA for f749c43

• Merge branch 'pipeline_parallelism_ohwi' into feature/42-pp_data_comm_func

  ohwi

  committed
  99ccfa2

  Copy full SHA for 99ccfa2

• implement TensorStub

  ohwi

  committed
  9a8150d

  Copy full SHA for 9a8150d

Commits on Sep 28, 2022

• clean PP code

  ohwi

  committed
  21c74f6

  Copy full SHA for 21c74f6

Commits on Sep 29, 2022

• remove activation save in eval mode

  ohwi

  committed
  80676f4

  Copy full SHA for 80676f4

• support torch.no_grad()

  ohwi

  committed
  18eeffc

  Copy full SHA for 18eeffc

• support amp (WIP)

  ohwi

  committed
  da6c087

  Copy full SHA for da6c087

Commits on Sep 30, 2022

• Revert "support amp (WIP)"

  Show description for 8d80aa7
  ohwi

  committed
  8d80aa7

  Copy full SHA for 8d80aa7

• pre-commit

  ohwi

  committed
  8ab949d

  Copy full SHA for 8ab949d