Code

Cleaned padding#59

Code

Merged

kshitijkg merged 11 commits intomultimodalCERC-AAI/multimodal:multimodalfrom cleaned_paddingCERC-AAI/multimodal:cleaned_paddingCopy head branch name to clipboardOct 26, 2023

+599-287

Commits

Commits on Oct 22, 2023

• cleaned data creation & unified tokenizer, padding

  kshitijkg

  committed
  05a6760

Commits on Oct 23, 2023

• Fixed preprocessing, added padding

  kshitijkg

  committed
  ea005d9

• Added dataloader checkpointing

  kshitijkg

  committed
  0330e50

• Added test for 0 images

  kshitijkg

  committed
  8e52a4f

Commits on Oct 24, 2023

• Merge pull request #60 from AGI-Collective/dataloader

  Show description for 8a8e91d
  kshitijkg

  authored
  8a8e91d

• Added vision start token masking

  kshitijkg

  committed
  730e4ef

• Using position pad id from args

  kshitijkg

  committed
  b984a20

• Merge branch 'cleaned_padding' of https://github.com/AGI-Collective/multimodal into cleaned_padding

  kshitijkg

  committed
  4dff4e2

Commits on Oct 26, 2023

• Parallelization encoding decoding to data creation

  kshitijkg

  committed
  be2c49e

• Added wandb logging directory

  kshitijkg

  committed
  a10520a

• Added dataloader checkpointing

  kshitijkg

  committed
  3803f5d