Skip to content

Commit

Permalink
fix config link 📘
Browse files Browse the repository at this point in the history
  • Loading branch information
Mayukhdeb authored Sep 15, 2022
1 parent 26c69a4 commit a69a575
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ pip install git+https://github.com/Aleph-Alpha/magma.git

Make sure that you also download the config:
```
mkdir configs; wget -O configs/MAGMA_v1.yml https://raw.githubusercontent.com/Aleph-Alpha/magma/add-setup/configs/MAGMA_v1.yml
mkdir configs; wget -O configs/MAGMA_v1.yml https://raw.githubusercontent.com/Aleph-Alpha/magma/master/configs/MAGMA_v1.yml
```

Or if you've cloned the repo, you can install all further requirements by:
Expand Down Expand Up @@ -126,4 +126,4 @@ deepspeed train.py --config path_to_my_config
```
To continue training from a deepspeed checkpoint, provide the checkpoint directory in the "load" config parameter.

WARNING: By default, instantiating magma via the init method instead of from_checkpoint loads the pretrained CLIP weights but not the pretrained gpt-j weights. For training MAGMA from scratch, download the gpt-j weights from this repo: https://github.com/finetuneanon/transformers and include them in the state dict after initializing the MAGMA model.
WARNING: By default, instantiating magma via the init method instead of from_checkpoint loads the pretrained CLIP weights but not the pretrained gpt-j weights. For training MAGMA from scratch, download the gpt-j weights from this repo: https://github.com/finetuneanon/transformers and include them in the state dict after initializing the MAGMA model.

0 comments on commit a69a575

Please sign in to comment.