Skip to content

Commit

Permalink
Use official DeepSpeedExamples
Browse files Browse the repository at this point in the history
  • Loading branch information
delock committed Feb 7, 2024
1 parent 0961d5f commit 092d007
Showing 1 changed file with 3 additions and 4 deletions.
7 changes: 3 additions & 4 deletions .github/workflows/autotp.yml
Original file line number Diff line number Diff line change
Expand Up @@ -99,8 +99,7 @@ jobs:
- name: Download DeepSpeedExamples
run: |
#git clone https://github.com/delock/DeepSpeedExamples --branch gma/hf_compare
git clone https://github.com/foin6/DeepSpeedExamples --branch dev
git clone https://github.com/Microsoft/DeepSpeedExamples
- name: Sanity check minimal
run: |
Expand All @@ -116,7 +115,7 @@ jobs:
export MODEL=facebook/opt-1.3b
cd DeepSpeedExamples/inference/huggingface/text-generation
deepspeed --num_gpus 2 --bind_cores_to_rank inference-test.py --model $MODEL --dtype bfloat16 --use_meta_tensor
deepspeed --num_gpus 2 --bind_cores_to_rank ds-hf-compare.py --model $MODEL --dtype bfloat16 --num_inputs 1 --use_kernel False
deepspeed --num_gpus 2 --bind_cores_to_rank ds-hf-compare.py --model $MODEL --dtype bfloat16 --num_inputs 1
- name: AutoTP test (bigscience/bloom-3b)
run: |
Expand All @@ -126,4 +125,4 @@ jobs:
export MODEL=bigscience/bloom-3b
cd DeepSpeedExamples/inference/huggingface/text-generation
deepspeed --num_gpus 2 --bind_cores_to_rank inference-test.py --model $MODEL --dtype bfloat16 --use_meta_tensor
deepspeed --num_gpus 2 --bind_cores_to_rank ds-hf-compare.py --model $MODEL --dtype bfloat16 --num_inputs 1 --use_kernel False
deepspeed --num_gpus 2 --bind_cores_to_rank ds-hf-compare.py --model $MODEL --dtype bfloat16 --num_inputs 1

0 comments on commit 092d007

Please sign in to comment.