Running on HPC Systems

OLCF Summit

Load modules

module load cmake

Get an interactive job

bsub -W 2:00 -nnodes 1 -P [your project ID] -q debug -alloc_flags "smt1" -Is /bin/bash

Build Charm++ (with PAMILRTS machine layer)

./build charm++ pamilrts-linux-ppc64le smp -j --with-production

Run a Charm++ application

jsrun -n2 -a1 -c21 -K1 -r2 ./hello +ppn 20 +pemap L0-19 +commap L20

SDSC Expanse

Load modules

module load sdsc gcc/10.2.0 openmpi/4.0.4 cmake hwloc

Get an interactive job

srun --partition=debug --pty --account=[your account #] --nodes=1 --ntasks-per-node=4 --cpus-per-task=4 --mem=32G -t 00:30:00 --wait=0 --export=ALL /bin/bash

Build Charm++ (with UCX machine layer)

./build charm++ ucx-linux-x86_64 smp -j --with-production

Run a Charm++ application

srun --cpu_bind=cores --mpi=pmi2 ./hello +ppn 3 +pemap L0-2,4-6,8-10,12-14 +commap L3,7,11,15