Skip to content

Commit

Permalink
[ci] fix: add force stop in ray e2e ci to clean env (#112)
Browse files Browse the repository at this point in the history
- As titled
  • Loading branch information
PeterSH6 authored Jan 17, 2025
1 parent d0152e1 commit ff0c7cc
Show file tree
Hide file tree
Showing 3 changed files with 7 additions and 1 deletion.
1 change: 1 addition & 0 deletions .github/workflows/e2e_digit_completion.yml
Original file line number Diff line number Diff line change
Expand Up @@ -37,4 +37,5 @@ jobs:
pip3 install -e .[test]
- name: Running digit completon e2e training tests on 8 L20 GPUs
run: |
ray stop --force
bash tests/e2e/run_ray_trainer.sh
5 changes: 5 additions & 0 deletions .github/workflows/e2e_gsm8k.yml
Original file line number Diff line number Diff line change
Expand Up @@ -37,16 +37,21 @@ jobs:
pip3 install -e .[test]
- name: Prepare gsm8k dataset
run: |
ray stop --force
python3 examples/data_preprocess/gsm8k.py
- name: Running gsm8k e2e training tests on 8 L20 GPUs with rmpad using function rm
run: |
ray stop --force
bash tests/e2e/run_qwen_gsm8k_function_rm.sh
- name: Running gsm8k e2e without rmpad using function rm
run: |
ray stop --force
bash tests/e2e/run_qwen_gsm8k_function_rm_no_rmpad.sh
- name: Running gsm8k e2e with rmpad using model rm
run: |
ray stop --force
bash tests/e2e/run_qwen_gsm8k_model_rm.sh
- name: Running gsm8k e2e without rmpad using model rm
run: |
ray stop --force
bash tests/e2e/run_qwen_gsm8k_model_rm_no_rmpad.sh
2 changes: 1 addition & 1 deletion .github/workflows/model.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ on:
- .github/workflows/model.yml

jobs:
e2e_gpu:
model_rmpad:
runs-on: [self-hosted, l20-1]
env:
HTTP_PROXY: ${{ secrets.PROXY_HTTP }}
Expand Down

0 comments on commit ff0c7cc

Please sign in to comment.