Vlasiator gpu #1404
GitHub Actions / Testpackage result
failed
Jan 17, 2025 in 0s
Testpackage result
0 tests with zero diffs, 6 tests with diffs, 18 tests failed.
Details
Testpackage output:
CI_reference pointed to 052cbaf1674e4d47996306b267194c2fa73e2fb2__DACC_SEMILAG_PQM__DTRANS_SEMILAG_PPM__DDP__DDPF__DVEC4D_AGNER
🔶 acctest_1_maxw_500k_100k_20kms_10deg: Nonzero diffs: `proton/vg_rho` has absolute error , `proton/vg_rho` has relative error . Max timestamp difference is 0.. Speedup: 1.03297
Stdout:
(MAIN): Completed grid initialization.
(MAIN): Starting main simulation loop.
(MAIN): Completed requested simulation. Exiting.
----------
running acctest_1_maxw_500k_100k_20kms_10deg
----------
--------------------------------
ref-time | new-time | speedup |
--------------------------------
4.417 4.276 1.03297
-------------------------------------------
variable | absolute diff | relative diff |
-------------------------------------------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/testpackage/run_2025.01.16_16.27.03/acctest_1_maxw_500k_100k_20kms_10deg/fullf.0000000.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/testpackage/run_2025.01.16_16.27.03/acctest_1_maxw_500k_100k_20kms_10deg/fullf.0000001.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/testpackage/run_2025.01.16_16.27.03/acctest_1_maxw_500k_100k_20kms_10deg/fullf.0000002.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/testpackage/run_2025.01.16_16.27.03/acctest_1_maxw_500k_100k_20kms_10deg/fullf.0000020.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Stderr:
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35186,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35140,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35166,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35120,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35082,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35094,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35305,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35267,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35285,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35247,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35256,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35218,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35428,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35454,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35408,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35420,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35382,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35336,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35554,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35572,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
🔶 acctest_2_maxw_500k_100k_20kms_10deg: Nonzero diffs: `proton/vg_rho` has absolute error , `proton/vg_rho` has relative error . Max timestamp difference is 0.. Speedup: 1.02796
Stdout:
(MAIN): Completed grid initialization.
(MAIN): Starting main simulation loop.
(MAIN): Completed requested simulation. Exiting.
----------
running acctest_2_maxw_500k_100k_20kms_10deg
----------
--------------------------------
ref-time | new-time | speedup |
--------------------------------
1.985 1.931 1.02796
-------------------------------------------
variable | absolute diff | relative diff |
-------------------------------------------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/testpackage/run_2025.01.16_16.27.03/acctest_2_maxw_500k_100k_20kms_10deg/fullf.0000001.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Stderr:
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35469,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35687,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35705,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35667,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35627,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
🔶 acctest_3_substeps: Nonzero diffs: `proton/vg_rho` has absolute error , `proton/vg_rho` has relative error . Max timestamp difference is 0.. Speedup: 1.05755
Stdout:
(MAIN): Completed grid initialization.
(MAIN): Starting main simulation loop.
(MAIN): Completed requested simulation. Exiting.
----------
running acctest_3_substeps
----------
--------------------------------
ref-time | new-time | speedup |
--------------------------------
59.54 56.3 1.05755
-------------------------------------------
variable | absolute diff | relative diff |
-------------------------------------------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/testpackage/run_2025.01.16_16.27.03/acctest_3_substeps/fullf.0000001.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Stderr:
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35782,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35800,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35762,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35716,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[35742,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
🔶 acctest_4_helium: Nonzero diffs: `helium/vg_rho` has absolute error , `helium/vg_rho` has relative error . Max timestamp difference is 0.. Speedup: 1.03524
Stdout:
(MAIN): Completed grid initialization.
(MAIN): Starting main simulation loop.
(MAIN): Completed requested simulation. Exiting.
----------
running acctest_4_helium
----------
--------------------------------
ref-time | new-time | speedup |
--------------------------------
20.86 20.15 1.03524
-------------------------------------------
variable | absolute diff | relative diff |
-------------------------------------------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/testpackage/run_2025.01.16_16.27.03/acctest_4_helium/fullf.0000001.vlsv against reference
helium/vg_rho_0
helium/vg_v_0
helium/vg_v_1
helium/vg_v_2
VLSV file timestamps match.
----------
Stderr:
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46132,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46094,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46304,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46546,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
🔶 acctest_5_proton_antiproton: Nonzero diffs: `proton/vg_rho` has absolute error , `proton/vg_rho` has relative error . Max timestamp difference is 0.. Speedup: 0.995706
Stdout:
(MAIN): Completed grid initialization.
(MAIN): Starting main simulation loop.
(MAIN): Completed requested simulation. Exiting.
----------
running acctest_5_proton_antiproton
----------
--------------------------------
ref-time | new-time | speedup |
--------------------------------
0.1623 0.163 0.995706
-------------------------------------------
variable | absolute diff | relative diff |
-------------------------------------------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/testpackage/run_2025.01.16_16.27.03/acctest_5_proton_antiproton/fullf.0000000.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/testpackage/run_2025.01.16_16.27.03/acctest_5_proton_antiproton/fullf.0000001.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Comparing file /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/testpackage/run_2025.01.16_16.27.03/acctest_5_proton_antiproton/fullf.0000002.vlsv against reference
proton/vg_rho_0
proton/vg_v_0
proton/vg_v_1
proton/vg_v_2
----------
Distribution function diff
----------
VLSV file timestamps match.
----------
Stderr:
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46717,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46679,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46633,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46595,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46820,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46832,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46794,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46812,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46772,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46734,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46746,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46956,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46918,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46936,1],0]
Exit code: 127
--------------------------------------------------------------------------
/wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlsvdiff_DP: error while loading shared libraries: libpapi.so.6.0: cannot open shared object file: No such file or directory
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[46898,1],0]
Exit code: 127
--------------------------------------------------------------------------
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:1: BEGIN{print (!= 0.0)?1:0}
awk: cmd. line:1: ^ syntax error
🔴 Flowthrough_trans_periodic: Failed to run or died with an error.
Stdout:
Stderr:
[carrington-802:1581953:0:1581953] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x5d)
==== backtrace (tid:1581953) ====
0 0x000000000004eb80 killpg() ???:0
1 0x0000000000569382 dccrg::Dccrg<spatial_cell::SpatialCell, dccrg::Cartesian_Geometry, std::tuple<>, std::tuple<> >::update_copies_of_remote_neighbors() /wrk-vakka/appl/easybuild/opt/GCCcore/13.2.0/include/c++/13.2.0/bits/hashtable.h:1940
2 0x000000000056998c adjustVelocityBlocks() /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/grid.cpp:779
3 0x0000000000573dc7 initializeGrids() /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/grid.cpp:297
4 0x00000000005b96e7 simulate() /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator.cpp:469
5 0x0000000000427aa1 main() /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator.cpp:1429
6 0x000000000003ad85 __libc_start_main() ???:0
7 0x000000000042937e _start() ???:0
=================================
[carrington-802:1581953] *** Process received signal ***
[carrington-802:1581953] Signal: Segmentation fault (11)
[carrington-802:1581953] Signal code: (-6)
[carrington-802:1581953] Failing at address: 0x1002dc00182381
[carrington-802:1581953] [ 0] /lib64/libc.so.6(+0x4eb80)[0x7f1fcbe17b80]
[carrington-802:1581953] [ 1] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator[0x569382]
[carrington-802:1581953] [ 2] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator[0x56998c]
[carrington-802:1581953] [ 3] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator[0x573dc7]
[carrington-802:1581953] [ 4] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator[0x5b96e7]
[carrington-802:1581953] [ 5] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator[0x427aa1]
[carrington-802:1581953] [ 6] /lib64/libc.so.6(__libc_start_main+0xe5)[0x7f1fcbe03d85]
[carrington-802:1581953] [ 7] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator[0x42937e]
[carrington-802:1581953] *** End of error message ***
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun noticed that process rank 6 with PID 1581953 on node carrington-802 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------
🔴 Flowthrough_x_inflow_y_outflow: Failed to run or died with an error.
Stdout:
[1737037830.952178] [carrington-802:1582200:0] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 8 was not set in ucs
[1737037830.952184] [carrington-802:1582200:1] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
Stderr:
[carrington-802:1582199:0:1582199] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x82)
[carrington-802:1582198:0:1582198] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f6bedad24e0)
[carrington-802:1582200:0:1582328] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x31)
[carrington-802:1582200:1:1582340] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x45)
[carrington-802:1582197:0:1582197] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f8fe4265800)
[carrington-802:1582200] *** Process received signal ***
[carrington-802:1582200] Signal: Segmentation fault (11)
[carrington-802:1582200] Signal code: Address not mapped (1)
[carrington-802:1582200] Failing at address: 0x7fe564661800
[carrington-802:1582197] *** Process received signal ***
[carrington-802:1582197] Signal: Segmentation fault (11)
[carrington-802:1582197] Signal code: Address not mapped (1)
[carrington-802:1582197] Failing at address: 0x7fcd9e460800
terminate called after throwing an instance of 'std::out_of_range'
what(): unordered_map::at
[carrington-802:1582208] *** Process received signal ***
[carrington-802:1582208] Signal: Aborted (6)
[carrington-802:1582208] Signal code: (-6)
[carrington-802:1582208] [ 0] /lib64/libc.so.6(+0x4eb80)[0x7f570c933b80]
[carrington-802:1582208] [ 1] /lib64/libc.so.6(gsignal+0x10f)[0x7f570c933aff]
[carrington-802:1582208] [ 2] /lib64/libc.so.6(abort+0x127)[0x7f570c906ea5]
[carrington-802:1582208] [ 3] /wrk-vakka/appl/easybuild/opt/GCCcore/13.2.0/lib64/libstdc++.so.6(+0xacbeb)[0x7f570d0ffbeb]
[carrington-802:1582208] [ 4] /wrk-vakka/appl/easybuild/opt/GCCcore/13.2.0/lib64/libstdc++.so.6(+0xbc39a)[0x7f570d10f39a]
[carrington-802:1582208] [ 5] /wrk-vakka/appl/easybuild/opt/GCCcore/13.2.0/lib64/libstdc++.so.6(+0xbc405)[0x7f570d10f405]
[carrington-802:1582208] [ 6] /wrk-vakka/appl/easybuild/opt/GCCcore/13.2.0/lib64/libstdc++.so.6(+0xbc658)[0x7f570d10f658]
[carrington-802:1582208] [ 7] /wrk-vakka/appl/easybuild/opt/GCCcore/13.2.0/lib64/libstdc++.so.6(_ZSt20__throw_out_of_rangePKc+0x40)[0x7f570d1024be]
[carrington-802:1582208] [ 8] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator[0x5693ca]
[carrington-802:1582208] [ 9] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator[0x56998c]
[carrington-802:1582208] [10] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator[0x573dc7]
[carrington-802:1582208] [11] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator[0x5b96e7]
[carrington-802:1582208] [12] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator[0x427aa1]
[carrington-802:1582208] [13] /lib64/libc.so.6(__libc_start_main+0xe5)[0x7f570c91fd85]
[carrington-802:1582208] [14] /wrk-vakka/group/spacephysics/proj/CI/turso-carrington-mjalho/_work/vlasiator/vlasiator/vlasiator[0x42937e]
[carrington-802:1582208] *** End of error message ***
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun noticed that process rank 3 with PID 1582200 on node carrington-802 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------
🔴 Flowthrough_x_inflow_y_outflow_acc: Failed to run or died with an error.
Stdout:
[1737037832.201647] [carrington-802:1582468:1] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 8 was not set in ucs
[1737037832.201692] [carrington-802:1582468:1] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737037832.201648] [carrington-802:1582468:0] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737037832.201660] [carrington-802:1582468:2] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737037832.201701] [carrington-802:1582468:3] debug.c:1294 UCX WARN ucs_debug_disable_signal: signal 8 was not set in ucs
[1737037832.201780] [carrington-802:1582468:2] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
[1737037832.201771] [carrington-802:1582468:0] spinlock.c:29 UCX WARN ucs_recursive_spinlock_destroy() failed: busy
Stderr:
[carrington-802:1582465:0:1582465] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f8d4c8d2360)
[carrington-802:1582475:0:1582626] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7f8d4c83c008)
[carrington-802:1582480:0:1582480] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x192)
[carrington-802:1582468:0:1582468] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7fe9ca910a78)
[carrington-802:1582468:2:1582607] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7fe9ca910e48)
[carrington-802:1582468:1:1582597] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7fe9ca86d358)
[carrington-802:1582468:3:1582617] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x7fe9ca86d058)
[carrington-802:1582475] *** Process received signal ***
[carrington-802:1582475] Signal: Segmentation fault (11)
[carrington-802:1582475] Signal code: Address not mapped (1)
[carrington-802:1582475] Failing at address: 0x7fa56026d130
termi
Loading