Merge branch 'msaroufim/wandb' of https://github.com/pytorch/torchtitan…

… into msaroufim/wandb
pytorch · Dec 3, 2024 · b5e0ebf · b5e0ebf
2 parents b4cf6a3 + a1b1a8d
commit b5e0ebf
Showing 1 changed file with 4 additions and 4 deletions.
diff --git a/README.md b/README.md
@@ -85,11 +85,11 @@ Once you have confirmed access, you can run the following command to download th
 ```bash
 # Get your HF token from https://huggingface.co/settings/tokens
 
-# Llama 3.1 tokenizer.model
-python torchtitan/datasets/download_tokenizer.py --repo_id meta-llama/Meta-Llama-3.1-8B --tokenizer_path "original" --hf_token=...
+# Llama 3 or 3.1 tokenizer.model
+python torchtitan/datasets/download_tokenizer.py --repo_id meta-llama/Meta-Llama-3-8B --tokenizer_path "original" --hf_token=...
 
-# Llama 3.2 tokenizer.model
-python torchtitan/datasets/download_tokenizer.py --repo_id meta-llama/Llama-3.2-3B --hf_token=...
+# Llama 2 tokenizer.model
+python torchtitan/datasets/download_tokenizer.py --repo_id meta-llama/Llama-2-13b-hf --hf_token=...
 ```
 
 ### Start a training run