Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates to improve compliance with the IOOS Compliance Checker (glide… #163

Open
wants to merge 104 commits into
base: main
Choose a base branch
from

Conversation

jcermauwedu
Copy link

…rdac:3.0)

  • Still need to ignore ancillary_variable recommendations or skip specific test
  • ncprocess.py
    • profile_id: Max int32 type; attributes valid max and min also need to be same type; _FillValue = -999
    • platform: Max int32 type; _FillValue = -999
    • set time encoding to float to avoid UserWarnings about time conversion
  • slocum.py
    • If import test fails for dbdreader, the flag should be False for have_dbdreader?
    • Need pandas to help avoid UserWarnings about time conversion; set encoding to float for time encoding
    • depth: valid min/max and _FillValue updates to match gliderdac:3.0
    • Other updates from char to float to match gliderdac:3.0
    • Obtain direct version of libnetcdf (borrow code from xarray)
  • tests
    • Add README to discover location of example data

Other things that should be added/updated to respective deployment.yml files to improve compliance. Once that is done, things are squeaky clean.

$ compliance-checker -t gliderdac:3.0 -s check_ancillary_variables pyglider/L0-profiles/unit507-20240325T1507.nc
Running Compliance Checker on the datasets from: ['pyglider/L0-profiles/unit507-20240325T1507.nc']

--------------------------------------------------------------------------------
                         IOOS Compliance Checker Report
                                Version unknown
                     Report generated 2024-03-26T00:50:22Z
                                 gliderdac:3.0
      https://ioos.github.io/glider-dac/ngdac-netcdf-file-format-version-2
--------------------------------------------------------------------------------
All tests passed!

…rdac:3.0)

 * Still need to ignore `ancillary_variable` recommendations
 * ncprocess.py
   * profile_id: Max int32 type; attributes valid max and min also need to be same type; _FillValue = -999
   * platform: Max int32 type; _FillValue = -999
   * set time encoding to float to avoid UserWarnings about time conversion
 * slocum.py
   * If import test fails for dbdreader, the flag should be False for have_dbdreader?
   * Need pandas to help avoid UserWarnings about time conversion; set encoding to float for time encoding
   * depth: valid min/max and _FillValue updates to match gliderdac:3.0
   * Other updates from char to float to match gliderdac:3.0
   * Obtain direct version of libnetcdf (borrow code from xarray)
 * tests
   * Add README to discover location of example data

Other things that should be added/updated to respective deployment.yml files to improve
compliance.  Once that is done, things are squeaky clean.

```
$ compliance-checker -t gliderdac:3.0 -s check_ancillary_variables pyglider/L0-profiles/unit507-20240325T1507.nc
Running Compliance Checker on the datasets from: ['pyglider/L0-profiles/unit507-20240325T1507.nc']

--------------------------------------------------------------------------------
                         IOOS Compliance Checker Report
                                Version unknown
                     Report generated 2024-03-26T00:50:22Z
                                 gliderdac:3.0
      https://ioos.github.io/glider-dac/ngdac-netcdf-file-format-version-2
--------------------------------------------------------------------------------
All tests passed!
```
@jklymak jklymak force-pushed the main branch 3 times, most recently from fc6deb2 to 9cec8bf Compare March 28, 2024 01:34
jklymak and others added 30 commits September 22, 2024 08:54
DOC: minor change to test pypi workflow
DOC: minor change to test pypi workflow
 * We do not want to ignore the first line of any data
 * Do not interpolate the data (get_sync -> get)
 * .gitignore: Ignore build directory
 * Ignore build directory
 * Add gitignore files and directories created by running pytest
 * Allow setting time and calendar units from yml configuration file
 * Fix to allow profile_time_start and profile_time_end to get time
   information by moving time_1970 to last variable processed in
   for loop
 * Emit warning for variables lacking data for gridding
 * Add resync_metadata_and_encoding to allow overriding of metadata
   from yml configuration file
 * Fix log message for raw_to_timeseries
 * Allow conversion of slocum latitude and longitude from NMEA to degrees
 * Emit log message when metadata is overridden from yml configuration file
 * Add utils function to determine pyglider version
 * Add utils function to determine netcdf C and python versions
 * Set units for profile_time in example-slocum/deploymentRealtime.yml to
   get proper units for profile_time
 * Remove history and netcdf attributes as they can now vary widely from
   static examples
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants