Skip to content

Commit b736ca9

Browse files
committed
Fix user guide
1 parent cae5c3c commit b736ca9

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

USER_GUIDE.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ export ZONE=your-tpu-zone
1616
export PROJECT=your-tpu-project
1717
```
1818

19-
### HF Mixtral 7 x 8B Environment Setup
19+
### HF Llama Environment Setup
2020

2121
Here both PyTorch and PyTorch/XLA nightly are used with our fork of HuggingFace.
2222
```
@@ -60,7 +60,7 @@ The last step for HF setup is to copy your fsdp_config.json into the TPU VM.
6060
```
6161
{
6262
"fsdp_transformer_layer_cls_to_wrap": [
63-
"MixtralDecoderLayer"
63+
"LlamaDecoderLayer"
6464
],
6565
"xla": true,
6666
"xla_fsdp_v2": true,

0 commit comments

Comments
 (0)