Vlasiator gpu #1411
GitHub Actions / Testpackage result
failed
Jan 17, 2025 in 0s
Testpackage result
0 tests with zero diffs, 6 tests with diffs, 18 tests failed.
Details
Testpackage output:
CI_reference pointed to 052cbaf1674e4d47996306b267194c2fa73e2fb2__DACC_SEMILAG_PQM__DTRANS_SEMILAG_PPM__DDP__DDPF__DVEC4D_AGNER
🔶 acctest_1_maxw_500k_100k_20kms_10deg: Nonzero diffs: `proton/vg_rho` has absolute error , `proton/vg_rho` has relative error . Max timestamp difference is 0.. Speedup: 1.02316
Stdout:
(MAIN): Completed grid initialization.
(MAIN): Starting main simulation loop.
(MAIN): Completed requested simulation. Exiting.
----------
running acctest_1_maxw_500k_100k_20kms_10deg
----------
--------------------------------
ref-time | new-time | speedup |
--------------------------------
4.417 4.317 1.02316
-------------------------------------------
variable | absolute diff | relative diff |
-------------------------------------------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/testpackage/run_2025.01.17_16.45.23/acctest_1_maxw_500k_100k_20kms_10deg/fullf.0000000.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/testpackage/run_2025.01.17_16.45.23/acctest_1_maxw_500k_100k_20kms_10deg/fullf.0000001.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/testpackage/run_2025.01.17_16.45.23/acctest_1_maxw_500k_100k_20kms_10deg/fullf.0000002.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/testpackage/run_2025.01.17_16.45.23/acctest_1_maxw_500k_100k_20kms_10deg/fullf.0000020.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Stderr:
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[53036,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[53062,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[53072,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[53098,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52868,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52872,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52898,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52924,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52950,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52960,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52980,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52750,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52760,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52786,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52812,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52816,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52841,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52611,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52637,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52663,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
🔶 acctest_2_maxw_500k_100k_20kms_10deg: Nonzero diffs: `proton/vg_rho` has absolute error , `proton/vg_rho` has relative error . Max timestamp difference is 0.. Speedup: 1.01327
Stdout:
(MAIN): Completed grid initialization.
(MAIN): Starting main simulation loop.
(MAIN): Completed requested simulation. Exiting.
----------
running acctest_2_maxw_500k_100k_20kms_10deg
----------
--------------------------------
ref-time | new-time | speedup |
--------------------------------
1.985 1.959 1.01327
-------------------------------------------
variable | absolute diff | relative diff |
-------------------------------------------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/testpackage/run_2025.01.17_16.45.23/acctest_2_maxw_500k_100k_20kms_10deg/fullf.0000001.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Stderr:
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52494,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52504,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52530,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52555,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52581,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
🔶 acctest_3_substeps: Nonzero diffs: `proton/vg_rho` has absolute error , `proton/vg_rho` has relative error . Max timestamp difference is 0.. Speedup: 1.0512
Stdout:
(MAIN): Completed grid initialization.
(MAIN): Starting main simulation loop.
(MAIN): Completed requested simulation. Exiting.
----------
running acctest_3_substeps
----------
--------------------------------
ref-time | new-time | speedup |
--------------------------------
59.54 56.64 1.0512
-------------------------------------------
variable | absolute diff | relative diff |
-------------------------------------------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/testpackage/run_2025.01.17_16.45.23/acctest_3_substeps/fullf.0000001.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Stderr:
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52408,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52434,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52460,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52230,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52240,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
🔶 acctest_4_helium: Nonzero diffs: `helium/vg_rho` has absolute error , `helium/vg_rho` has relative error . Max timestamp difference is 0.. Speedup: 1.02405
Stdout:
(MAIN): Completed grid initialization.
(MAIN): Starting main simulation loop.
(MAIN): Completed requested simulation. Exiting.
----------
running acctest_4_helium
----------
--------------------------------
ref-time | new-time | speedup |
--------------------------------
20.86 20.37 1.02405
-------------------------------------------
variable | absolute diff | relative diff |
-------------------------------------------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/testpackage/run_2025.01.17_16.45.23/acctest_4_helium/fullf.0000001.vlsv against reference
helium/vg_rho_0
helium/vg_v_0
helium/vg_v_1
helium/vg_v_2
VLSV file timestamps match.
----------
Stderr:
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52349,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52119,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52128,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52154,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
🔶 acctest_5_proton_antiproton: Nonzero diffs: `proton/vg_rho` has absolute error , `proton/vg_rho` has relative error . Max timestamp difference is 0.. Speedup: 0.992054
Stdout:
(MAIN): Completed grid initialization.
(MAIN): Starting main simulation loop.
(MAIN): Completed requested simulation. Exiting.
----------
running acctest_5_proton_antiproton
----------
--------------------------------
ref-time | new-time | speedup |
--------------------------------
0.1623 0.1636 0.992054
-------------------------------------------
variable | absolute diff | relative diff |
-------------------------------------------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/testpackage/run_2025.01.17_16.45.23/acctest_5_proton_antiproton/fullf.0000000.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/testpackage/run_2025.01.17_16.45.23/acctest_5_proton_antiproton/fullf.0000001.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/testpackage/run_2025.01.17_16.45.23/acctest_5_proton_antiproton/fullf.0000002.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Stderr:
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52003,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52029,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52055,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52065,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[52091,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[51854,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[51864,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[51890,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[51916,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[51942,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[51946,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[51716,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[51742,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[51752,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[51778,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
🔴 Flowthrough_trans_periodic: Failed to run or died with an error.
Stdout:
[1737125329.722485] [carrington-804:4191732:0] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 1 was not set in ucs
[1737125329.722486] [carrington-804:4191732:1] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125329.722483] [carrington-804:4191733:0] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 8 was not set in ucs
[1737125329.722536] [carrington-804:4191733:1] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 8 was not set in ucs
[1737125329.722555] [carrington-804:4191733:2] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 11 was not set in ucs
[1737125329.722598] [carrington-804:4191733:2] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125329.722601] [carrington-804:4191733:3] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 8 was not set in ucs
[1737125329.722498] [carrington-804:4191741:0] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125329.722500] [carrington-804:4191741:1] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 1 was not set in ucs
[1737125329.722549] [carrington-804:4191741:1] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125329.722505] [carrington-804:4191741:2] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125329.722558] [carrington-804:4191741:3] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 1 was not set in ucs
[1737125329.722640] [carrington-804:4191741:2] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125329.722483] [carrington-804:4191742:0] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 8 was not set in ucs
[1737125329.722529] [carrington-804:4191742:1] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 8 was not set in ucs
[1737125329.722549] [carrington-804:4191742:1] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125329.722532] [carrington-804:4191742:0] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125329.722599] [carrington-804:4191742:0] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125329.722557] [carrington-804:4191742:2] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 1 was not set in ucs
[1737125329.722602] [carrington-804:4191742:1] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125329.722642] [carrington-804:4191741:1] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125329.722642] [carrington-804:4191741:0] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125329.722538] [carrington-804:4191733:0] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
Stderr:
[carrington-804:4191742:0:4191874] Caught signal 11 (Segmentation fault: address not mapped to object at address 0xf9)
[carrington-804:4191742:1:4191865] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f8f8986d380)
[carrington-804:4191742:2:4191880] Caught signal 11 (Segmentation fault: address not mapped to object at address 0xd2)
[carrington-804:4191741:2:4191846] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f8f8986d388)
[carrington-804:4191741:0:4191741] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f8f8986d508)
[carrington-804:4191741:1:4191855] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f8f8986d288)
[carrington-804:4191741:3:4191859] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f8f6b5dbe18)
[carrington-804:4191732:0:4191882] Caught signal 11 (Segmentation fault: address not mapped to object at address 0xbb)
[carrington-804:4191732:1:4191732] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x55)
[carrington-804:4191732] *** Process received signal ***
[carrington-804:4191732] Signal: Segmentation fault (11)
[carrington-804:4191732] Signal code: Address not mapped (1)
[carrington-804:4191732] Failing at address: 0xbb
[carrington-804:4191733:2:4191733] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f8f8986d508)
[carrington-804:4191733:1:4191861] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f8f8986d488)
[carrington-804:4191733:3:4191868] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f8f8986d388)
[carrington-804:4191733:0:4191850] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f8f8986d488)
[carrington-804:4191742] *** Process received signal ***
[carrington-804:4191742] Signal: Segmentation fault (11)
[carrington-804:4191742] Signal code: Address not mapped (1)
[carrington-804:4191742] Failing at address: 0x7f8f6b443800
[carrington-804:4191742] [ 0] /lib64/libc.so.6(+0x4eb80)[0x7f2bd07ccb80]
[carrington-804:4191742] [ 1] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlasiator[0x603fa0]
[carrington-804:4191742] [ 2] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlasiator[0x607587]
[carrington-804:4191742] [ 3] /wrk-vakka/appl/easybuild/opt/GCCcore/13.2.0/lib64/libgomp.so.1(GOMP_parallel+0x46)[0x7f2bd1b6e106]
[carrington-804:4191742] [ 4] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlasiator[0x6080f6]
[carrington-804:4191742] [ 5] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlasiator[0x5699c8]
[carrington-804:4191742] [ 6] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlasiator[0x573db7]
[carrington-804:4191742] [ 7] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlasiator[0x5b97f7]
[carrington-804:4191742] [ 8] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlasiator[0x427a91]
[carrington-804:4191742] [ 9] /lib64/libc.so.6(__libc_start_main+0xe5)[0x7f2bd07b8d85]
[carrington-804:4191742] [10] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-ykempf/_work/vlasiator/vlasiator/vlasiator[0x42936e]
[carrington-804:4191742] *** End of error message ***
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun noticed that process rank 11 with PID 4191742 on node carrington-804 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------
🔴 Flowthrough_x_inflow_y_outflow: Failed to run or died with an error.
Stdout:
[1737125331.391918] [carrington-804:4192022:0] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 8 was not set in ucs
[1737125331.391963] [carrington-804:4192022:0] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125331.391962] [carrington-804:4192022:1] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 1 was not set in ucs
[1737125331.391994] [carrington-804:4192022:1] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125331.392007] [carrington-804:4192022:2] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 8 was not set in ucs
[1737125331.392055] [carrington-804:4192022:2] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125331.392065] [carrington-804:4192022:3] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 1 was not set in ucs
[1737125331.392048] [carrington-804:4192022:1] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125331.392080] [carrington-804:4192022:2] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125331.394955] [carrington-804:4192017:0] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737125331.394963] [carrington-804:4192017:1] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 1 was not set in ucs
Stderr:
[carrington-804:4192022:1:4192154] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f082a067c48)
[carrington-804:4192022:2:4192161] Caught signal 11 (Segmentation fault: address not mapped to object at address 0xd1)
[carrington-804:4192022:0:4192022] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f082a06d768)
[carrington-804:4192022:3:4192147] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f0803e08200)
[carrington-804:4192008:0:4192008] Caught signal 11 (Segm
Loading