Cannot compile NVSHMEM under CUDA 12.8

[ghostplant]

nvcc -DHAVE_CUB -ccbin=mpic++ -dc -Xcompiler -fopenmp -lineinfo -DUSE_NVTX -ldl -gencode arch=compute_70,code=sm_70 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -gencode arch=compute_90,code=compute_90 -std=c++14 -I/usr/include -I/usr/include/nvshmem_12 jacobi.cu -c -o jacobi.o
nvcc warning : Support for offline compilation for architectures prior to '<compute/sm/lto>_75' will be removed in a future release (Use -Wno-deprecated-gpu-targets to suppress warning).
nvcc -gencode arch=compute_70,code=sm_70 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -gencode arch=compute_90,code=compute_90 jacobi.o -o jacobi -ccbin=mpic++ -L/usr/lib -lnvshmem -L/usr/local/cuda/lib64 -lcuda -lcudart -ldl -lnvidia-ml
nvcc warning : Support for offline compilation for architectures prior to '<compute/sm/lto>_75' will be removed in a future release (Use -Wno-deprecated-gpu-targets to suppress warning).
nvlink error   : Undefined reference to '_Z23nvshmemi_transfer_rma_pIfEvPvT_i' in 'jacobi.o' (target: sm_70)
nvlink error   : Undefined reference to '_Z25nvshmemi_transfer_rma_nbiIL13threadgroup_t2EL13nvshmemi_op_t1EEvPvS2_mi' in 'jacobi.o' (target: sm_70)
nvlink error   : Undefined reference to '_Z23nvshmemi_transfer_quietIL13threadgroup_t0EEvb' in 'jacobi.o' (target: sm_70)
nvlink error   : Undefined reference to '_Z30nvshmemi_transfer_amo_nonfetchImEvPvT_i14nvshmemi_amo_t' in 'jacobi.o' (target: sm_70)
nvlink error   : Undefined reference to '_Z36nvshmemi_transfer_syncapi_update_memv' in 'jacobi.o' (target: sm_70)
nvlink error   : Undefined reference to 'nvshmemi_device_state_d' in 'jacobi.o' (target: sm_70)
make: *** [Makefile:38: jacobi] Error 255

[jirikraus]

This issue occurs because your NVSHMEM build is not complied with Volta (CC 7.0) support. You can unblock yourself by removing $(GENCODE_SM70) from line 23 in the Makefile

GENCODE_FLAGS	:= $(GENCODE_SM70) $(GENCODE_SM80) $(GENCODE_SM90)

see https://github.com/NVIDIA/multi-gpu-programming-models/blob/master/nvshmem/Makefile#L23C18-L23C33

this will drop CC 7.0 build from the NVSHMEM example so that the sm_70 NVSHMEM device symbols are no longer required.

Please confirm if this unblocks you and keep the issue open. I would like to keep the issue open as a reminder how to handle this going forward.