Skip to content

Release 2.0.1 #53

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 26 commits into from
Jun 18, 2025
Merged

Release 2.0.1 #53

merged 26 commits into from
Jun 18, 2025

Conversation

olivhoenen
Copy link
Collaborator

@olivhoenen olivhoenen commented Jun 18, 2025

Release notes

  • improve DD3-->DD4 conversion (sign conversion to dodpsi_like)
  • improve conversion of pulse_schedule IDS >= 3.39.0
  • numpy 2 compatibility
  • improve UDA data fetch
  • improve documentation
  • new dependency on imas-data-dictionaries package (remove internal build via saxonche)
  • full compatibility of tests with netCDF<1.7 (no complex numbers)

olivhoenen and others added 23 commits March 20, 2025 15:33
Select `imas_core` when the URI starts with `imas:`, otherwise use the
netCDF backend.

This change allows using NCZarr [1] as storage engine (when it is
enabled in the netCDF4 python module) by using `file://`, `s3://` or
`https://` style URIs.

[1] https://docs.unidata.ucar.edu/nug/current/nczarr_head.html
Pytest runs successfully with numpy 2.x, so we should be able to remove this restriction.
We request `ids_properties/homogeneous_time` and
`ids_properties/version_put/data_dictionary` in two separate calls
to the backend before actually getting all data. This is fine for local
backends, but UDA would fetch the data three times:

1. When determining the DD version and if the IDS exists
2. When determining whether the IDS uses homogeneous time
3. When actually reading the data

This commit adds a `datapath="ids_properties"` to the first two cases.
This results in UDA only fetching the IDS properties in points 1 and 2.
The full IDS is now requested once by UDA, in point 3.
…ert_ids call

This prevents polluting the output of the CLI `imas convert` and explict `imas.convert_ids` calls with lots of repeated warnings.
The Data Dictionary definitions are now provided by the `imas-data-dictionaries` package.
Copy link
Collaborator

@maarten-ic maarten-ic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Olivier!

Some small comments on the readme changes.

allow using nzcarr for storing netCDF format

The commit that did this was also reverted later. I'd suggest to remove this item from the changelog.

Co-authored-by: Maarten Sebregts <[email protected]>
@olivhoenen olivhoenen merged commit 5c95ebc into main Jun 18, 2025
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants