From 265e43c42a6b1da4993fd954e22b48e53b9bf81d Mon Sep 17 00:00:00 2001 From: Zhanghao Wu Date: Thu, 30 May 2024 22:17:05 +0000 Subject: [PATCH] Add single GPU --- llm/gpt-2/README.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/llm/gpt-2/README.md b/llm/gpt-2/README.md index ce50011810e..45b616e09df 100644 --- a/llm/gpt-2/README.md +++ b/llm/gpt-2/README.md @@ -16,6 +16,11 @@ sky launch -c gpt2-data gpt2-data.yaml --env BUCKET_NAME=your-bucket-name sky launch -c gpt2-train --detach-setup gpt2-train.yaml --env BUCKET_NAME=your-bucket-name ``` +Or you can train the model with a single A100: +```bash +sky launch -c gpt2-train --detach-setup gpt2-train.yaml --gpu a100 --env BUCKET_NAME=your-bucket-name +``` + ## Run in a Pipeline We can also combine the two steps into a single SkyPilot job: