Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ADIOS I/O type Limitations/On-going work #553

Open
jayeshkrishna opened this issue Dec 5, 2023 · 0 comments
Open

ADIOS I/O type Limitations/On-going work #553

jayeshkrishna opened this issue Dec 5, 2023 · 0 comments
Assignees
Labels
ADIOS All ADIOS related issues/enhancements enhancement

Comments

@jayeshkrishna
Copy link
Contributor

jayeshkrishna commented Dec 5, 2023

-- DRAFT --
ADIOS I/O TYPE LIMITATIONS
SCORPIO

  • Reading/writing with different I/O decompositions does not work
  • Reading/writing with different number of MPI processes does not work
  • Open to update a variable does not work
  • Open to append an existing file does not work
  • Overwriting existing attributes (with multiple pio_put_att calls on the same attribute) does not work
  • Get of variables with dimensions >= 4D is not supported
  • Redefine mode (to rename or delete an existing variable or attribute) is not supported
  • To put/get a NetCDF variable (the variable type does not matter), the write buffer for pio_get_var and the read buffer for pio_get_var must use the same data type. If we use a double type write buffer to put a NC_INT variable and later use a float type read buffer to get it, the read buffer would contain incorrect values (missing required double to float type conversion)

ESMCI CIME

  • CIME checks for NetCDF files for restart runs (requires files in the ".nc" extension). ADIOS "files" have ".bp" extension.
    ** As a workaround one can create dummy ".nc" files corresponding to ".bp" files to circumvent the CIME check
    UPDATE: For ADIOS file (BP directory) foo.nc.bp SCORPIO now creates a corresponding symbolic link foo.nc

E3SM

  • MPAS does not support read using the ADIOS I/O type (the changes in env_run.xml XML file is not reflected in MPAS stream files)

SUGGESTED ENHANCEMENTS
E3SM

  • Allow E3SM/SCREAM to write restart files and history files using different I/O types (e.g. Write restarts using ADIOS while writing history files using PnetCDF)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ADIOS All ADIOS related issues/enhancements enhancement
Projects
None yet
Development

No branches or pull requests

2 participants