Skip to content

Commit

Permalink
Reduce testing to a handful of passing cases
Browse files Browse the repository at this point in the history
Running the entire llvm-test-suite - or even the first N
cases - does not give us a predictable, reliable set of
regression tests.

But the 36 cases among
llvm-test-suite/{SingleSource/Regression/C,External/SPEC,Bitcode/Regression}
all pass for O0, O2 and MinSize test configs and they only take
a ~few minutes to run on QEMU linux-userspace emulation.

Signed-off-by: Brian Cain <[email protected]>
  • Loading branch information
androm3da committed Sep 6, 2024
1 parent 54f46bb commit e5818a5
Showing 1 changed file with 5 additions and 2 deletions.
7 changes: 5 additions & 2 deletions test-toolchain.sh
Original file line number Diff line number Diff line change
Expand Up @@ -39,8 +39,11 @@ test_llvm() {

cmake --build ./obj_test-suite_${OPT_FLAVOR} -- -v -k 0
# cmake --build ./obj_test-suite_${OPT_FLAVOR} -- -v check
python3 ${BASE}/obj_llvm/bin/llvm-lit -v --max-tests=${LLVM_TS_LIMIT} \
--timeout=${LLVM_TS_PER_TEST_TIMEOUT_SEC} ./obj_test-suite_${OPT_FLAVOR}
python3 ${BASE}/obj_llvm/bin/llvm-lit -v \
--max-tests=${LLVM_TS_LIMIT} \
--timeout=${LLVM_TS_PER_TEST_TIMEOUT_SEC} \
-o ${RESULTS_DIR}/test_res_${OPT_FLAVOR}.json \
./obj_test-suite_${OPT_FLAVOR}/{SingleSource/Regression/C,External/SPEC,Bitcode/Regression}
llvm_result=${?}
}

Expand Down

0 comments on commit e5818a5

Please sign in to comment.