Unable to compile with Spack

[jbzambon]

I'm having an issue compiling WRF while following along with the docs. After successfully setting up the virtual cluster through the ParallelCluster UI, I am able to login build the compilers, successfully build NCL, but it dies when trying to compile WRF. I've done some troubleshooting and am stuck, so I've included my output from a simple recitation of the tutorial. I've attached the complete output of my attempt.

Interestingly, openssl-1.1.1n builds successfully for NCL but not for WRF (openssl-1.1.1o).

I apologize as I'm a novice user of Spack but find its capabilities exciting for future rollouts of virtual AWS clusters. In the past, I compiled all of the dependencies for WRF and other geophysical models (ROMS, SWAN, COAWST, etc) from scratch. Please let me know if there is any other information that would be helpful to troubleshoot, thanks!

module av
module load intelmpi
mpirun -V

export SPACK_ROOT=/shared/spack
git clone -b v0.18.1 -c feature.manyFiles=true https://github.com/spack/spack $SPACK_ROOT
echo "export SPACK_ROOT=/shared/spack" >> $HOME/.bashrc
echo "source \$SPACK_ROOT/share/spack/setup-env.sh" >> $HOME/.bashrc
source $HOME/.bashrc

pip3 install botocore boto3

spack mirror add aws-hpc-weather s3://aws-hpc-weather/spack/
spack buildcache keys --install --trust --force

spack install --no-cache [email protected]

spack load intel-oneapi-compilers
spack compiler find
spack unload
spack compilers

spack install --no-cache intel-oneapi-mpi+external-libfabric%intel

spack install ncl^[email protected]

spack install -j $(nproc) [email protected]%intel build_type=dm+sm ^intel-oneapi-mpi+external-libfabric

The main error output...

==> Installing parallel-netcdf-1.12.2-vbvawpeou2czrkpmfm24b3ra6yvnk7q4
==> No binary for parallel-netcdf-1.12.2-vbvawpeou2czrkpmfm24b3ra6yvnk7q4 found: installing from source
==> Warning: Intel's compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors
==> Fetching https://mirror.spack.io/_source-cache/archive/3e/3ef1411875b07955f519a5b03278c31e566976357ddfc74c2493a1076e7d7c74.tar.gz
==> No patches needed for parallel-netcdf
==> parallel-netcdf: Executing phase: 'autoreconf'
==> parallel-netcdf: Executing phase: 'configure'
==> parallel-netcdf: Executing phase: 'build'
==> Error: ProcessError: Command exited with status 2:
    'make' '-j8' 'V=1'

5 errors found in build log:
     730    /bin/sh ../../../libtool  --tag=F77   --mode=compile /shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/intel-oneapi-mpi-20
            21.6.0-hnsm3uvui2iuwoyxu533fwtve4jywnhj/mpi/2021.6.0/bin/mpif77  -fPIC -c -o strerrorf.lo strerrorf.f
     731    /bin/sh ../../../libtool  --tag=F77   --mode=compile /shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/intel-oneapi-mpi-20
            21.6.0-hnsm3uvui2iuwoyxu533fwtve4jywnhj/mpi/2021.6.0/bin/mpif77  -fPIC -c -o strerrnof.lo strerrnof.f
     732    /bin/sh ../../../libtool  --tag=F77   --mode=compile /shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/intel-oneapi-mpi-20
            21.6.0-hnsm3uvui2iuwoyxu533fwtve4jywnhj/mpi/2021.6.0/bin/mpif77  -fPIC -c -o inq_libversf.lo inq_libversf.f
     733    rm -f mpifnetcdf.h issyserrf.c xstrerrorf.c xstrerrnof.c xinq_libversf.c allf.c
     734    ./buildiface -infile=../../../src/include/pnetcdf.h -deffile=./defs > allf.c
     735    libtool: compile:  /shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/intel-oneapi-mpi-2021.6.0-hnsm3uvui2iuwoyxu533fwtve4j
            ywnhj/mpi/2021.6.0/bin/mpif77 -fPIC -c strerrnof.f  -fPIC -o .libs/strerrnof.o
  >> 736    perl: error while loading shared libraries: libimf.so: cannot open shared object file: No such file or directory
  >> 737    make[3]: *** [mpifnetcdf.h] Error 127
     738    make[3]: *** Waiting for unfinished jobs....
     739    libtool: compile:  /shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/intel-oneapi-mpi-2021.6.0-hnsm3uvui2iuwoyxu533fwtve4j
            ywnhj/mpi/2021.6.0/bin/mpif77 -fPIC -c inq_libversf.f  -fPIC -o .libs/inq_libversf.o
     740    libtool: compile:  /shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/intel-oneapi-mpi-2021.6.0-hnsm3uvui2iuwoyxu533fwtve4j
            ywnhj/mpi/2021.6.0/bin/mpif77 -fPIC -c strerrorf.f  -fPIC -o .libs/strerrorf.o
     741    libtool: compile:  /shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/intel-oneapi-mpi-2021.6.0-hnsm3uvui2iuwoyxu533fwtve4j
            ywnhj/mpi/2021.6.0/bin/mpif77 -fPIC -c inq_libversf.f -o inq_libversf.o >/dev/null 2>&1
     742    libtool: compile:  /shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/intel-oneapi-mpi-2021.6.0-hnsm3uvui2iuwoyxu533fwtve4j
            ywnhj/mpi/2021.6.0/bin/mpif77 -fPIC -c strerrnof.f -o strerrnof.o >/dev/null 2>&1
     743    libtool: compile:  /shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/intel-oneapi-mpi-2021.6.0-hnsm3uvui2iuwoyxu533fwtve4j
            ywnhj/mpi/2021.6.0/bin/mpif77 -fPIC -c strerrorf.f -o strerrorf.o >/dev/null 2>&1
     744    make[3]: Leaving directory `/tmp/ec2-user/spack-stage/spack-stage-parallel-netcdf-1.12.2-vbvawpeou2czrkpmfm24b3ra6yvnk7q4/spack-
            src/src/binding/f77'
  >> 745    make[2]: *** [all-recursive] Error 1
     746    make[2]: Leaving directory `/tmp/ec2-user/spack-stage/spack-stage-parallel-netcdf-1.12.2-vbvawpeou2czrkpmfm24b3ra6yvnk7q4/spack-
            src/src/binding'
  >> 747    make[1]: *** [all-recursive] Error 1
     748    make[1]: Leaving directory `/tmp/ec2-user/spack-stage/spack-stage-parallel-netcdf-1.12.2-vbvawpeou2czrkpmfm24b3ra6yvnk7q4/spack-
            src/src'
  >> 749    make: *** [all-recursive] Error 1

See build log for details:
  /tmp/ec2-user/spack-stage/spack-stage-parallel-netcdf-1.12.2-vbvawpeou2czrkpmfm24b3ra6yvnk7q4/spack-build-out.txt

==> Warning: Skipping build of wrf-4.3.3-q43kfj6xj25lbyd7tohsi7pfgg62l57f since parallel-netcdf-1.12.2-vbvawpeou2czrkpmfm24b3ra6yvnk7q4 failed
==> Installing openssl-1.1.1o-7eigwum4w3arklmtc3x63mi57secrbws
==> Warning: download_tarball() was unable to download [email protected]%[email protected]~docs~shared certs=system arch=linux-amzn2-zen2 ^[email protected]%[email protected]+cxx~docs+stl patches=b231fcc arch=linux-amzn2-zen2 ^[email protected]%[email protected]~debug~pic+shared arch=linux-amzn2-zen2 ^[email protected]%[email protected] arch=linux-amzn2-zen2 ^[email protected]%[email protected] arch=linux-amzn2-zen2 ^[email protected]%[email protected] libs=shared,static arch=linux-amzn2-zen2 ^[email protected]%[email protected]~symlinks+termlib abi=none arch=linux-amzn2-zen2 ^[email protected]%[email protected]+cpanm+shared+threads arch=linux-amzn2-zen2 ^[email protected]%[email protected] arch=linux-amzn2-zen2 ^[email protected]%[email protected] arch=linux-amzn2-zen2 ^[email protected]%[email protected]+optimize+pic+shared patches=0d38234 arch=linux-amzn2-zen2 from any configured mirrors
==> openssl exists in binary cache but with different hash
==> No binary for openssl-1.1.1o-7eigwum4w3arklmtc3x63mi57secrbws found: installing from source
==> Warning: Intel's compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors
==> Fetching https://mirror.spack.io/_source-cache/archive/93/9384a2b0570dd80358841464677115df785edb941c71211f75076d72fe6b438f.tar.gz
==> Ran patch() for openssl
==> openssl: Executing phase: 'install'
==> Error: ProcessError: Command exited with status 1:
    './config' '--prefix=/shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/openssl-1.1.1o-7eigwum4w3arklmtc3x63mi57secrbws' '--openssldir=/shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/openssl-1.1.1o-7eigwum4w3arklmtc3x63mi57secrbws/etc/openssl' '-I/shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/zlib-1.2.12-bivduls2kbl5em3mewikzh3gcafam724/include' '-L/shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/zlib-1.2.12-bivduls2kbl5em3mewikzh3gcafam724/lib' 'zlib' 'shared'

2 errors found in build log:
  >> 4    /shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/perl-5.34.1-mjhobm5lqoq7frdx4wz4fpu3ra3az3rs/bin/perl: error while loading
           shared libraries: libimf.so: cannot open shared object file: No such file or directory
  >> 5    /shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/perl-5.34.1-mjhobm5lqoq7frdx4wz4fpu3ra3az3rs/bin/perl: error while loading
           shared libraries: libimf.so: cannot open shared object file: No such file or directory
     6    This system (linux-x86_64) is not supported. See file INSTALL for details.

See build log for details:
  /tmp/ec2-user/spack-stage/spack-stage-openssl-1.1.1o-7eigwum4w3arklmtc3x63mi57secrbws/spack-build-out.txt

==> Warning: Skipping build of krb5-1.19.3-b4ksts5s3i5sdpcgakbh6pyqzoeytgdr since openssl-1.1.1o-7eigwum4w3arklmtc3x63mi57secrbws failed
==> Warning: Skipping build of libtirpc-1.2.6-mq24tfptfpmruz4ike2jxkufu6zn7aak since krb5-1.19.3-b4ksts5s3i5sdpcgakbh6pyqzoeytgdr failed
==> Warning: Skipping build of cmake-3.23.1-gbsknahxsnoaxbqmsw5el6aphn2a2nz4 since openssl-1.1.1o-7eigwum4w3arklmtc3x63mi57secrbws failed
==> Warning: Skipping build of jasper-3.0.3-xftwt2gr4bscvwlbnkv3ang3s6oyvm5h since cmake-3.23.1-gbsknahxsnoaxbqmsw5el6aphn2a2nz4 failed
==> Warning: Skipping build of hdf5-1.12.2-2ivulvnnsiymntes6bivudmqcalefers since cmake-3.23.1-gbsknahxsnoaxbqmsw5el6aphn2a2nz4 failed
==> Warning: Skipping build of netcdf-c-4.8.1-sd5rolyick3mou3nq3acahernwhl64xo since hdf5-1.12.2-2ivulvnnsiymntes6bivudmqcalefers failed
==> Warning: Skipping build of netcdf-fortran-4.5.4-z5oohwqemh2kt53ifzymzn2t5znfafj2 since netcdf-c-4.8.1-sd5rolyick3mou3nq3acahernwhl64xo failed
==> Warning: Skipping build of libjpeg-turbo-2.1.3-klvncicpz5ayt25dsjomdvh2q2y7qo7g since cmake-3.23.1-gbsknahxsnoaxbqmsw5el6aphn2a2nz4 failed
==> Error: wrf-4.3.3-q43kfj6xj25lbyd7tohsi7pfgg62l57f: Package was not installed
==> Error: Installation request failed.  Refer to reported errors for failing package(s).

$ more /tmp/ec2-user/spack-stage/spack-stage-openssl-1.1.1o-7eigwum4w3arklmtc3x63mi57secrbws/spack-build-out.txt
==> openssl: Executing phase: 'install'
==> [2022-12-01-16:14:23.069206] './config' '--prefix=/shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/openssl-1.1.1o-7eigwum4w3arklmt
c3x63mi57secrbws' '--openssldir=/shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/openssl-1.1.1o-7eigwum4w3arklmtc3x63mi57secrbws/etc/o
penssl' '-I/shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/zlib-1.2.12-bivduls2kbl5em3mewikzh3gcafam724/include' '-L/shared/spack/opt
/spack/linux-amzn2-zen2/intel-2021.5.0/zlib-1.2.12-bivduls2kbl5em3mewikzh3gcafam724/lib' 'zlib' 'shared'
Operating system: x86_64-whatever-linux2
/shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/perl-5.34.1-mjhobm5lqoq7frdx4wz4fpu3ra3az3rs/bin/perl: error while loading shared lib
raries: libimf.so: cannot open shared object file: No such file or directory
/shared/spack/opt/spack/linux-amzn2-zen2/intel-2021.5.0/perl-5.34.1-mjhobm5lqoq7frdx4wz4fpu3ra3az3rs/bin/perl: error while loading shared lib
raries: libimf.so: cannot open shared object file: No such file or directory
This system (linux-x86_64) is not supported. See file INSTALL for details.

[fullout.txt](https://github.com/aws-samples/aws-hpc-tutorials/files/10134090/fullout.txt)
[ui_template.txt](https://github.com/aws-samples/aws-hpc-tutorials/files/10134091/ui_template.txt)

[jefffor]

I had the same issue, will let you know if I find a solution.

[GISTech01]

Hi @sean-smith, were you able to resolve the following as I'm unable to compile WRF with Spack using the steps outlined in the following AWS workshop - Weather Research and Forecasting (WRF). Any advice will be appreciated as we are trying to demo the following for a AWS client.

[sean-smith]

@GISTech01 What's the error message?

[GISTech01]

Hi @sean-smith
I've tried to rerun the installation and compilation of WRF using the instructions in the AWS HPC Workshop (ie., NCL installation steps ) and it fails sooner on the installation of NCL.

[ec2-user@ip-172-31-22-152 ~]$ spack install ncl^[email protected]
==> Installing libiconv-1.16-wxhskd3ewxhcz3tldwulying7uw5mg3d
==> Warning: download_tarball() was unable to download [email protected]%[email protected] libs=shared,static arch=linux-amzn2-zen from any configured mirrors
==> libiconv exists in binary cache but with different hash
==> No binary for libiconv-1.16-wxhskd3ewxhcz3tldwulying7uw5mg3d found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/e6/e6a1b1b589654277ee790cce3734f07876ac4ccfaecbee8afa0b649cf529cc04.tar.gz
==> No patches needed for libiconv
==> libiconv: Executing phase: 'autoreconf'
==> libiconv: Executing phase: 'configure'
==> libiconv: Executing phase: 'build'
==> libiconv: Executing phase: 'install'
==> libiconv: Successfully installed libiconv-1.16-wxhskd3ewxhcz3tldwulying7uw5mg3d
  Fetch: 0.46s.  Build: 15.29s.  Total: 15.74s.
[+] /shared/spack/opt/spack/linux-amzn2-zen/gcc-7.3.1/libiconv-1.16-wxhskd3ewxhcz3tldwulying7uw5mg3d...

==> Installing libmd-1.0.4-eu2fznretanmeqq5eurrhsm2qforkxw7
gpg: Signature made Mon 09 Jan 2023 07:55:34 PM UTC using RSA key ID DEC8E01E
gpg: Good signature from "AWS HPC Weather <[email protected]>"
==> Warning: Skipping build of libbsd-0.11.5-axtynt37ig53ql67ocozqrwirdkvgfcc since libmd-1.0.4-eu2fznretanmeqq5eurrhsm2qforkxw7 failed
==> Warning: Skipping build of libxdmcp-1.1.2-2tsvr2zgw56tc53q35ps3w7nldcoov5d since libbsd-0.11.5-axtynt37ig53ql67ocozqrwirdkvgfcc failed
==> Warning: Skipping build of libxcb-1.14-gwocekxn7tpkpdxvt3infllytfl6sotr since libxdmcp-1.1.2-2tsvr2zgw56tc53q35ps3w7nldcoov5d failed
==> Warning: Skipping build of cairo-1.16.0-fftscn2hhpty4nkmdlyqy7hw7ybjy5xs since libxcb-1.14-gwocekxn7tpkpdxvt3infllytfl6sotr failed
==> Warning: Skipping build of ncl-6.6.2-sx7ujb4xfzch4poiruhkgbywztlmbz64 since cairo-1.16.0-fftscn2hhpty4nkmdlyqy7hw7ybjy5xs failed
==> Warning: Skipping build of libx11-1.7.0-t3c4esep35e4v3nvtvmfp5jrsq7yf7jg since libxcb-1.14-gwocekxn7tpkpdxvt3infllytfl6sotr failed
==> Warning: Skipping build of libxext-1.3.3-z642k6hrfekummaiiovn4c4tp3676f5a since libx11-1.7.0-t3c4esep35e4v3nvtvmfp5jrsq7yf7jg failed
==> Warning: Skipping build of libxaw-1.0.13-wb2ctmqltds6teseqpbxupj4fjz3jyqh since libxext-1.3.3-z642k6hrfekummaiiovn4c4tp3676f5a failed
==> Warning: Skipping build of libxmu-1.1.2-a5dj44gah7b42ddsa2d2cnwtckqseryp since libxext-1.3.3-z642k6hrfekummaiiovn4c4tp3676f5a failed
==> Warning: Skipping build of libxrender-0.9.10-shp5vhugjdg6sbhpeubtxqwhm4kgcabz since libx11-1.7.0-t3c4esep35e4v3nvtvmfp5jrsq7yf7jg failed
==> Warning: Skipping build of libxpm-3.5.12-3icvagypdhwp7i4l3zstt2522dvx5y5h since libx11-1.7.0-t3c4esep35e4v3nvtvmfp5jrsq7yf7jg failed
==> Warning: Skipping build of libxt-1.1.5-gzj7sj5sfucydwgtlke46s5ngu3nhh6w since libx11-1.7.0-t3c4esep35e4v3nvtvmfp5jrsq7yf7jg failed
==> Warning: Skipping build of expat-2.4.8-yxdhix32sfw66de4eimcvartqjh7oqxj since libbsd-0.11.5-axtynt37ig53ql67ocozqrwirdkvgfcc failed
==> Warning: Skipping build of udunits-2.2.28-67cel72nnn533jvbrsierfciq3konwqw since expat-2.4.8-yxdhix32sfw66de4eimcvartqjh7oqxj failed
==> Warning: Skipping build of python-3.9.10-3etaiy4kleffz7kih6mmxcx3qirfgawz since expat-2.4.8-yxdhix32sfw66de4eimcvartqjh7oqxj failed
==> Warning: Skipping build of fontconfig-2.13.94-zdj4soofipyb2tfs2catzhocgb47rggp since python-3.9.10-3etaiy4kleffz7kih6mmxcx3qirfgawz failed
==> Warning: Skipping build of ninja-1.10.2-ovokbsrfp2cblelu3fu3qdd3dymcszti since python-3.9.10-3etaiy4kleffz7kih6mmxcx3qirfgawz failed
==> Warning: Skipping build of glib-2.70.4-gremjnlqkzm5zw2sgm7nslceb24ebpdf since ninja-1.10.2-ovokbsrfp2cblelu3fu3qdd3dymcszti failed
==> Warning: Skipping build of meson-0.61.2-wd7sakcfbpinyug4y44ud6ofpiny5s6c since ninja-1.10.2-ovokbsrfp2cblelu3fu3qdd3dymcszti failed
==> Warning: Skipping build of py-setuptools-59.4.0-odtisturvmbqneccoqkgymngmm273zuv since python-3.9.10-3etaiy4kleffz7kih6mmxcx3qirfgawz failed
==> Warning: Skipping build of py-pip-21.3.1-kbwijp3nuskuecwomcxkibj3oasr4jbd since python-3.9.10-3etaiy4kleffz7kih6mmxcx3qirfgawz failed
==> Warning: Skipping build of py-wheel-0.37.0-n3pu5fl5fmho2vqhpuzmizacb4e7leon since py-pip-21.3.1-kbwijp3nuskuecwomcxkibj3oasr4jbd failed
==> Error: Failed to install libmd due to NoVerifyException: Spack found new style signed binary packages, but was unable to verify any of them.  Please obtain and trust the correct public key.  If these are public spack binaries, please see the spack docs for locations where keys can be found....

==> Extracting esmf-8.2.0-7tpx2lhmnuyhowusk47rawyjx53ualht from binary cache
[+] /shared/spack/opt/spack/linux-amzn2-zen/gcc-7.3.1/esmf-8.2.0-7tpx2lhmnuyhowusk47rawyjx53ualht
==> Error: ncl-6.6.2-sx7ujb4xfzch4poiruhkgbywztlmbz64: Package was not installed
==> Error: Installation request failed.  Refer to reported errors for failing package(s).
[ec2-user@ip-172-31-22-152 ~]$

The previous error message was during the compiling and installing of WRF:

==> Installing openssl-1.1.1o-7eigwum4w3arklmt c 3x63mi57secrbws
=» Warning : down l oad_tarball () was unable to downl oad openss [email protected]%[email protected]~docs~shared cert s=system arch=1inux-amzn2-zen2 *[email protected]%[email protected]+Cxx ~docs +stl patches=b231fcc arch=linux-amz
n2-zen2 [email protected] 02l.5.0~debug pic+shared arch-1inux-amzn2-zen2 ^diffutilse3 .8%intele2021.5.0 arch-1inux-amzn2-zen 2 ^gdbme l . 1931intele2021.5.0 arch-l1nux-amzn2-zen2 ^libi convel.168intel@2021 5,0 11b3-5
hared, Static arch=llnuX-amzn2-zen2 *ncursesg5. 281ntele2021 .5. O~syml inks +termlib abi=none arch=linux-anzn2-zen2 °perlg5.34.81ntel@2021 .5.0+cpanm*shared+threads arch=linux-amzn2 -zen2 *pKgcon fe l.8.0$1ntelg2021.5.0
arch-linux-amzn2-zen2 readline g8 . 18intele2021 .5.0 arch=linux-amzn2-zen2 *zlibel.2.1281ntel82021 .5.0+0pt imize+pic+shared patches=0d38234 arch=linux-amzn2-zen2 from any configured mirrors
>openssl exiSts in DInary cache Dut with dirrerent nash
==> No binary for openssl-1 .1.lo-7eigwum4w3arklmt c3x63mi 57secrbws found: installing from source
==» Warn ing: Intel's compilers may or may not optimize to the same degree for non-Intel micropro cessors for opt imizations that are not unigue to Intel nier oprocessors
=» Fetching https: //mirror. spack. io/_sour ce-cache/archive/93/9384a2b0570dd8 0 358841464677115df785edb 94 1c71211f75076d72 fe 6b438f.tar . gz
==* Ran patch () Ior openssl
==> openssl : Executing phase:instal1"
==> Error: ProcessError: Command exited with status 1:
./con1g' --prerix=/shared/ spack/opt/spack/1inux-amzn2-2en2/intel-2021.5.0/openssl-1.l.lo-7eigwUm 4w3 arKLmtc3x6 3mL57secrbws'--9penssldir=/shared/spack/opt/spack/1inux-amzn2-zen2/1ntel-2021.5.0/openssl-i.l
.lo-7eigwumdw 3ark 1mtc3x63mi 57secrbws /etc/ openss 1' '-I/shared/spack/ opt/ spack/linux-amzn2-zen2/intel-2021.5.0/zlib-1.2. 12-bivduls2kbl5em3mewikzh 3gcafam7 24/include " '-L/shared/ spack/ opt / spack /1inux-amzn2-zen2/inte
l-2021.5.0/z1ib-1.2.12-bivduls2kbl5em3mewikzh3gcafam724/11b 2lib"shared
2 errors found in build log
shared/Spack/opt /spack/linux-amzn2-zen2/intel-2 021.5.0/perl-5 . 34.1-njhobm5 l qOq7Írdx4 wz 4 fpu3ra3az3rs/bin/perl : error while loading shared 1ibrarie s: libimE . so: cannot open shared object file: No such
1le or directory
/shared/spack/opt /spack/linux-amzn2-2en2/intel-2021.5.0/perl-5 .34.1-mjhobm5l qoq7Irdx4wz4 Epu3 ra3az 3rs/bin/perl error while loading shared iibraries: libimi. so: eannot open shared object file: No such
Tlle or directory
This system (11nux-x8 6_64) 15 not supported. See file INSTALL for details.
See build log for details :
tmp/ec2-user/spack-stage/ spack-stage-openss l-1.1.1o-7eigwum4w3arklmt c 3x63mi57secIDWS/spack-build-out.txt
==> Warning: Skipping build of krb5-l.19.3-b4ksts5s315sdpcgakbh 6pyqzoeyt gdr since openssl-1. 1.1o-7eigwum4w3 arklnte3x6 3mi 57secrbws failed
=*» Warning: skipping build of 1ibtirpc-1 .2. 6-mq24tfptfpmruzd ike2jxkufu6zn7aak since krb5-1.19.3-b4ksts5s3i 5sdpcgakbh 6pyqzoeytgdr failed
==*Warning: SKipping build or wrr-4.3.3-q43kTJ6Xj25Lbya/tohs1 /prgg6215/T S1nce 1ibtirpc-l.2.6-mg24trptrpmruz4ike2jRkuTu6Zn/aak raiLed
==> Warning: Skipping build of cmake-3 . 23.1-gbs knahxsnoaxbqmsw 5el 6aphn2a 2nz4 since openssl-1 .1.10-7eigwum4w3arklmtc 3x 63mi 57secrbws failed

[GISTech01]

Hi @jbzambon
Were you able to get your installation of WRF up and running? I'm receiving similar error messages to what you have received that seem to be associated with the Spack libraries for compiling and installing NCL and WRF.

[jbzambon]

@GISTech01 I was able to compile and run WRF on AWS hpc6a (c6a.2xlarge login, 2x hpc6a.48xlarge computes). Vs the tutorial, I had to make a couple changes. Namely, following from this bug, I had to change the permissions in the API Policies of the PCluster UI due to a change in underling services. I added logs:TagResource and logs:UntagResource to ParallelClusterClusterPolicy and ParallelClusterBuildImageManagedPolicy. This allowed the cluster to get spun up.

Then, when running through the rest of the tutorial, I built my own WRF executables and dependencies rather than use the mirror. Those mirror exe's don't seem to work. It takes longer to build, but I get successful builds. So, specifically, do not do anything in the Spack Build Cache section in "Install Spack". Hope that helps, running on hpc6a.48xlarge is fantastic!

[sean-smith]

Thanks @jbzambon we're tracking this. Bug described has a workaround documented here.