Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Don't merge] test new ut patch #24

Open
wants to merge 2 commits into
base: IDC_preCI_master
Choose a base branch
from
Open

[Don't merge] test new ut patch #24

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
cdbd75c
Update IDC_1100_Public_CI.yml
XumingGai Dec 28, 2023
a7b91c0
Update IDC_1100_Public_CI.yml
wendyliu235 Feb 4, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
32 changes: 17 additions & 15 deletions .github/workflows/IDC_1100_Public_CI.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ run-name: ${{ github.actor }} is testing out GitHub Action
on:
pull_request:
branches:
- main
- IDC_preCI_master

concurrency:
group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
Expand All @@ -30,7 +30,6 @@ jobs:
conda activate ${CONDA_ENV}
fi
pip install jax==0.4.20 jaxlib==0.4.20
pip install numpy
conda install libstdcxx-ng==12.2.0 -c conda-forge
pip install absl-py
pip list | grep numpy
Expand Down Expand Up @@ -79,24 +78,27 @@ jobs:
set +e
CONDA_ENV=openxla_preCI_${{ github.event.pull_request.number }}_${{ runner.name }}
source /opt/miniconda/bin/activate ${CONDA_ENV}
# install requirement from https://github.com/intel-innersource/frameworks.ai.infrastructure.intel-extension-for-tensorflow.jax/blob/yang/jax-v0.4.20/build/test-requirements.txt
# pip install -e . (install in local )
basekit_path=/home/sdp
source ${basekit_path}/intel/oneapi/compiler/latest/env/vars.sh
source ${basekit_path}/intel/oneapi/mkl/latest/env/vars.sh
git clone https://github.com/google/jax.git
cd jax && git checkout jaxlib-v0.4.20
patch -p1 -i ../test/jax_ut.patch
mkdir -p ./logs/ut
find ./tests -name "*.py" | sed 's#\./##g' |& tee ut_list.txt
file_path=./ut_list.txt

# get distribute ut list
if [ -d "jax_test" ]; then
echo "jax_test folder already exists. Doing nothing."
else
git clone https://github.com/wendyliu235/aipc_unify_validation_infr.git jax_test
fi
cd jax_test/openxla
pip install ./tools/*.whl
pip install -r test-requirements.txt
mkdir -p ./logs/ut
find ./tests -name "*.py" | sed 's#\./##g' |& tee ut_list.txt
file_path=./ut_list.txt
reference_file=./distribute_ut_list.txt

reference_file=jax_test/openxla/distribute_ut_list.txt
blacklist=jax_test/openxla/blacklist.txt
grep -v -f $blacklist $file_path > ut_list_filtered.txt
mv ut_list_filtered.txt $file_path

# run distribute ut first
# Check if the file exists
if [ -f "$file_path" ]; then
Expand Down Expand Up @@ -162,15 +164,15 @@ jobs:
uses: actions/upload-artifact@v3
with:
name: XLA-CI-Data
path: /home/sdp/actions-runner/workspace_openxla/intel-extension-for-openxla/intel-extension-for-openxla/jax_test/openxla/logs
path: /home/sdp/actions-runner/workspace_openxla/intel-extension-for-openxla/intel-extension-for-openxla/jax/logs
- name: Test Results Check
run: |
cd /home/sdp/actions-runner/workspace_openxla/intel-extension-for-openxla/intel-extension-for-openxla/jax_test/openxla
cd /home/sdp/actions-runner/workspace_openxla/intel-extension-for-openxla/intel-extension-for-openxla/jax
#UT results check
if [ -f "./logs/ut/err.log" ]; then
echo "exist fail cases"
cat ./logs/ut/err.log
exit 1
else
echo "run successful"
fi
fi
Loading