gsi-addon-dev environment needed on gaea-c6 for GSI

[jswhit]

Is your feature request related to a problem? Please describe.
ufs now compiles on gaea-c6, thanks to #1130

Describe the solution you'd like
we also need GSI for cycling, which requires the gsi-addon-dev environment

[jswhit]

I spoke too soon about ufs compiling - it apparently needs the upp-addon-dev environment which has not been built yet for c6

[jswhit]

see also ufs-community/ufs-weather-model#2407

[RatkoVasic-NOAA]

@jswhit I just installed upp-addon on Gaea-C6:
/ncrc/proj/epic/spack-stack/c6/spack-stack-1.6.0/envs/upp-addon-env/install/modulefiles/Core

Next installations on Gaea (starting with 1.8.0) will be on:
/usw/spack-stack/c5/
/usw/spack-stack/c6/
There is possibility that we will install older version (1.6.0) to that disk, but that will be later.

[jswhit]

thanks @RatkoVasic-NOAA. I saw that but didn't realize it was for c6 since it doesn't have "-c6" appended to the name. I'll try modifying the ufs_gaea modulefile for ufs and see if it compiles.

[jswhit]

edit ufs_gaea.intel to use /ncrc/proj/epic/spack-stack/c6/spack-stack-1.6.0/envs/upp-addon-env/install/modulefiles/Core and stack-intel/2023.2.0 doesn't quite work (some modules, hdf5 and netcdf-c in particular, are not found)

[RatkoVasic-NOAA]

@jswhit can you point me to your modulefile which is using /ncrc/proj/epic/spack-stack/c6/spack-stack-1.6.0/envs/upp-addon-env/install/modulefiles/Core on Gaea C6.

[jswhit]

@RatkoVasic-NOAA it is at /gpfs/f6/drsa-precip4/proj-shared/Jeffrey.S.Whitaker/ufs-weather-model-develop-atm/modulefiles/ufs_gaea.intel.lua. I only changed the module path (here's a git diff)

diff --git a/modulefiles/ufs_gaea.intel.lua b/modulefiles/ufs_gaea.intel.lua
index fb2eb49a..0f84248f 100644
--- a/modulefiles/ufs_gaea.intel.lua
+++ b/modulefiles/ufs_gaea.intel.lua
@@ -1,13 +1,13 @@
 help([[
   This module loads libraries required for building and running UFS Weather Model
-  on the NOAA RDHPC machine Gaea C5 using Intel-2023.1.0.
+  on the NOAA RDHPC machine Gaea C5 using Intel-2023.2.0.
 ]])

 whatis([===[Loads libraries needed for building the UFS Weather Model on Gaea ]===])

-prepend_path("MODULEPATH", "/ncrc/proj/epic/spack-stack/spack-stack-1.6.0/envs/upp-addon-env/install/modulefiles/Core")
+prepend_path("MODULEPATH", "/ncrc/proj/epic/spack-stack/c6/spack-stack-1.6.0/envs/upp-addon-env/install/modulefiles/Core")

-stack_intel_ver=os.getenv("stack_intel_ver") or "2023.1.0"
+stack_intel_ver=os.getenv("stack_intel_ver") or "2023.2.0"
 load(pathJoin("stack-intel", stack_intel_ver))

 stack_cray_mpich_ver=os.getenv("stack_cray_mpich_ver") or "8.1.25"
lines 1-21/21 (END)

[RatkoVasic-NOAA]

@jswhit I cannot access to the main directory, I'm not member of drsa-precip4 group:

Gaea:/ncrc/home2/Ratko.Vasic>ll -d /gpfs/f6/drsa-precip4/proj-shared/
drwxrws--- 3 root drsa-precip4 4096 Sep 05 2024 20:21:32 /gpfs/f6/drsa-precip4/proj-shared/

Can you please copy just your
/gpfs/f6/drsa-precip4/proj-shared/Jeffrey.S.Whitaker/ufs-weather-model-develop-atm/modulefiles
directory to your i.e. home directory: /ncrc/home2/Jeffrey.S.Whitaker

[jswhit]

Done

[RatkoVasic-NOAA]

@jswhit
you only need one small change in your ufs_gaea.intel.lua file:
replace
stack_cray_mpich_ver=os.getenv("stack_cray_mpich_ver") or "8.1.25"
with
stack_cray_mpich_ver=os.getenv("stack_cray_mpich_ver") or "8.1.29"

[jswhit]

thank you @RatkoVasic-NOAA that did the trick. If the gsi-addon-dev env can now be built for C6, I think I can make a similar change in the GSI modulefiles and get it to build.

[climbfuji]

Thanks @RatkoVasic-NOAA and @jswhit . Can we close this as completed?

[jswhit2]

still need the gsi-addon-dev environment for C6

[RatkoVasic-NOAA]

@jswhit it is already innstalled on Gaea C6:
/ncrc/proj/epic/spack-stack/c6/spack-stack-1.6.0/envs/gsi-addon/install/modulefiles/Core

[jswhit2]

ahh - sorry I didn't see that. Will you let you know today if I can use it to get GSI compiled

[jswhit2]

sort of works - the cmake configuration runs and the compilation starts, but then hangs. I'll file a gaea help ticket.

[jswhit2]

must have a been a filesystem issue - the compilation completes now. Thank you @RatkoVasic-NOAA, this issue can be closed.