Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade ADIOS2 libs with compression support on NERSC machines #6994

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Upgrade ADIOS2 libs with compression support on NERSC machines #6994

wants to merge 1 commit into from

Conversation

dqwu
Copy link
Contributor

@dqwu dqwu commented Feb 11, 2025

This PR upgrades ADIOS libs to version 2.10.2 on NERSC machines
with compression support enabled.

[BFB]

@dqwu
Upgrade ADIOS libs to 2.10.2 with compression support at NERSC
1def870 
Upgraded ADIOS libs to version 2.10.2 at NERSC with compression
support enabled. While older versions also support compression,
they were not built with it. This update facilitates testing of
lossless and lossy compression at NERSC.
@dqwu dqwu added Machine Files BFB PR leaves answers BFB pm-gpu Perlmutter machine at NERSC (GPU nodes) pm-cpu Perlmutter at NERSC (CPU-only nodes) labels Feb 11, 2025
@dqwu dqwu requested a review from ndkeen February 11, 2025 21:28
@ndkeen
Copy link
Contributor

ndkeen commented Feb 12, 2025

What tests were run for this already?

@dqwu
Copy link
Contributor Author

dqwu commented Feb 12, 2025

What tests were run for this already?

The following cases were built and run with this PR:
--compset F2010 --res ne120pg2_r05_oECv3
--compset GMPAS-NYF --res T62_oRRS18to6v3
--compset I1850GSWCNPRDCTCBC --res hcru_hcru

The following scream case was built with this PR:
--compset F2010-SCREAMv1 --res ne4pg2_ne4pg2

Build errors with some compilers (e.g. nvidiagpu) are also reproducible with current E3SM master (without this PR).

@ndkeen
Copy link
Contributor

ndkeen commented Feb 13, 2025

I just tried

SMS_D.ne4pg2_oQU480.F2010

and get a build error. For both intel and gnu.

CMake Error at cmake/modules/FindPIO.cmake:49 (find_package):
  By not providing "FindADIOS2.cmake" in CMAKE_MODULE_PATH this project has
  asked CMake to find a package configuration file provided by "ADIOS2", but
  CMake did not find one.

  Could not find a package configuration file provided by "ADIOS2" with any
  of the following names:

    ADIOS2Config.cmake
    adios2-config.cmake

@dqwu
Copy link
Contributor Author

dqwu commented Feb 13, 2025

I just tried

SMS_D.ne4pg2_oQU480.F2010

and get a build error. For both intel and gnu.

CMake Error at cmake/modules/FindPIO.cmake:49 (find_package):
  By not providing "FindADIOS2.cmake" in CMAKE_MODULE_PATH this project has
  asked CMake to find a package configuration file provided by "ADIOS2", but
  CMake did not find one.

  Could not find a package configuration file provided by "ADIOS2" with any
  of the following names:

    ADIOS2Config.cmake
    adios2-config.cmake

@ndkeen
It turns out I forgot to set read permissions on /global/cfs/cdirs/e3sm/3rdparty/adios2/2.10.2. Please retry. Thanks!

@jayeshkrishna jayeshkrishna added the SCORPIO The E3SM I/O library (derived from PIO) label Feb 14, 2025
@dqwu
Copy link
Contributor Author

dqwu commented Feb 27, 2025

@ndkeen, is this PR good to go? Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ndkeen ndkeen Awaiting requested review from ndkeen

At least 1 approving review is required to merge this pull request.

Assignees

@ndkeen ndkeen

Labels
BFB PR leaves answers BFB Machine Files pm-cpu Perlmutter at NERSC (CPU-only nodes) pm-gpu Perlmutter machine at NERSC (GPU nodes) SCORPIO The E3SM I/O library (derived from PIO)
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@dqwu @ndkeen @jayeshkrishna