We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 43cf469 commit ea013a7Copy full SHA for ea013a7
large_language_model_pretraining/nemo/pretrain_llama31.py
@@ -75,7 +75,7 @@ def slurm_executor(
75
gpus_per_node=devices,
76
mem="0",
77
exclusive=True,
78
- gres="gpu:8",
+ gres=f"gpu:{devices}",
79
packager=run.GitArchivePackager(),
80
dependencies=dependencies,
81
)
0 commit comments