Skip to content

Releases: NASA-PDS/validate

validate v3.6.0-SNAPSHOT

09 Aug 19:37
Compare
Choose a tag to compare
Pre-release
Update changelog

validate v3.5.2

12 Jun 18:16
Compare
Choose a tag to compare

Highlights

  • Memory leak fix for bundle validation - #826
  • Add WARNING messages for context product metadata mismatch with labels and new flag --disable-context-mismatch-warnings to disable the messages by @al-niessner in #890
  • Update functionality to throw ERROR for validation_format mismatch, and WARNING for field_format mismatch. by @al-niessner in #888
  • Numerous fixes to support special constants
  • Improve handling for high_instrument_saturation - #831
  • Update handling of Infinity / NaN values as special constants when they are not represented as the data type of the parent object. by @al-niessner in #894

What's Changed

Enhancements / Bug Fixes

  • Add retries to schematron downloads in the event of network connectivity issues by @al-niessner in #907
  • Update duplicate file check to only check for Product Observational by @al-niessner in #914
  • Fix URL handling on Windows OS by @al-niessner in #920
  • Update reference warning to throw on all --rule executions by @al-niessner in #921
  • Allow 64 bits to span more than 8 bytes (think shifted relative to byte boundaries) by @al-niessner in #922
  • Downgrade maven-site-plugin per bug with markdown by @jordanpadams in #934

Dependency Upgrades

  • Bump gov.nasa.pds:pds3-product-tools from 4.3.0 to 4.4.0 by @dependabot in #911
  • Update hashicorp/aws requirement from ~> 5.50.0 to ~> 5.51.1 in /terraform by @dependabot in #908
  • Bump commons-io:commons-io from 2.7 to 2.16.1 by @dependabot in #885
  • Bump com.google.code.gson:gson from 2.10.1 to 2.11.0 by @dependabot in #917
  • Bump commons-logging:commons-logging from 1.3.1 to 1.3.2 by @dependabot in #909
  • Update hashicorp/aws requirement from ~> 5.51.1 to ~> 5.52.0 in /terraform by @dependabot in #918
  • Bump com.fasterxml.jackson.core:jackson-databind from 2.17.0 to 2.17.1 by @dependabot in #910
  • Bump org.apache.maven.plugins:maven-site-plugin from 4.0.0-M14 to 4.0.0-M15 by @dependabot in #927

Full Changelog: v3.5.1...v3.5.2

validate v3.5.1

25 May 17:55
Compare
Choose a tag to compare

Highlights

  • Memory leak fix for bundle validation - #826
  • Add WARNING messages for context product metadata mismatch with labels and new flag --disable-context-mismatch-warnings to disable the messages by @al-niessner in #890
  • Update functionality to throw ERROR for validation_format mismatch, and WARNING for field_format mismatch. by @al-niessner in #888
  • Numerous fixes to support special constants
    • Improve handling for high_instrument_saturation - #831
    • Update handling of Infinity / NaN values as special constants when they are not represented as the data type of the parent object. by @al-niessner in #894
    • Update handling of Infinity / NaN values as special constants when they are not represented as the data type of the parent object. by @al-niessner in #894

🎉 Enhancements by External Contributors 🎉

Other Bug Fixes and Enhancements

  • Improved report generation to be more consistent across output formats by @al-niessner in #804
  • Update precision check to be less than or equal to by @jordanpadams in #815
  • Fix bug introduced by #308 when converting URLs to local paths on Windows by @jordanpadams in #818
  • Fix regression where unlabeled files are not being identified by @al-niessner in #836
  • handle float special constant maximum by @al-niessner in #843
  • Fix memory leaks and update PDF/A algorithm for non-document products by @al-niessner in #845
  • Fix bug for duplicate filenames used in different sub-directories by @al-niessner in #886
  • Fixes bugs with erroneous messages from output logs, duplicate records in collections, and handling of high_instrument_saturation special constants by @al-niessner in #859
  • Allow for special constant to be non-conformant with object's data type by @al-niessner in #893

Dependency Upgrades

  • Bump github/codeql-action from 2 to 3 in /.github/workflows by @dependabot in #802
  • Bump org.apache.maven.plugins:maven-site-plugin from 4.0.0-M11 to 4.0.0-M13 by @dependabot in #799
  • Bump actions/upload-artifact from 3 to 4 in /.github/workflows by @dependabot in #801
  • Update hashicorp/aws requirement from ~> 5.30.0 to ~> 5.31.0 in /terraform by @dependabot in #800
  • Bump com.google.code.gson:gson from 2.8.9 to 2.10.1 by @dependabot in #798
  • Bump actions/cache from 3 to 4 in /.github/workflows by @dependabot in #814
  • Bump org.codehaus.mojo:buildnumber-maven-plugin from 1.4 to 3.2.0 by @dependabot in #841
  • Bump com.google.guava:guava from 32.0.0-jre to 33.0.0-jre by @dependabot in #838
  • Bump commons-logging:commons-logging from 1.2 to 1.3.0 by @dependabot in #806
  • Bump org.apache.commons:commons-compress from 1.25.0 to 1.26.0 by @dependabot in #834
  • Bump org.jsoup:jsoup from 1.15.3 to 1.17.2 by @dependabot in #808
  • Bump org.apache.logging.log4j:log4j-core from 2.22.0 to 2.23.0 by @dependabot in #848
  • Bump net.sf.saxon:Saxon-HE from 12.3 to 12.4 by @dependabot in #847
  • Bump org.apache.commons:commons-compress from 1.26.0 to 1.26.1 by @dependabot in #851
  • Bump org.apache.solr:solr-solrj from 7.7.2 to 9.5.0 by @dependabot in #828
  • Bump gov.nasa:pds from 1.15.0 to 1.16.0 by @dependabot in #864
  • Bump commons-logging:commons-logging from 1.3.0 to 1.3.1 by @dependabot in #863
  • Bump com.fasterxml.jackson.core:jackson-databind from 2.14.2 to 2.17.0 by @dependabot in #870
  • Bump org.verapdf:validation-model from 1.24.1 to 1.24.2 by @dependabot in #869
  • Bump org.junit.jupiter:junit-jupiter from 5.7.0 to 5.10.2 by @dependabot in #871
  • Bump org.verapdf:validation-model-jakarta from 1.24.1 to 1.24.2 by @dependabot in #878
  • Bump commons-cli:commons-cli from 1.6.0 to 1.7.0 by @dependabot in #876
  • Bump org.apache.maven.plugins:maven-surefire-plugin from 3.2.2 to 3.2.5 by @dependabot in #877
  • Bump org.apache.maven.plugins:maven-assembly-plugin from 3.6.0 to 3.7.1 by @dependabot in #883
  • Bump com.google.guava:guava from 33.0.0-jre to 33.2.0-jre by @dependabot in #892
  • Catch NumberFormatException when values in data do not match spec in label by @al-niessner in #889
  • Bump org.apache.logging.log4j:log4j-core from 2.23.0 to 2.23.1 by @dependabot in #900
  • Bump org.slf4j:slf4j-nop from 2.0.9 to 2.0.13 by @dependabot in #898
  • Bump org.junit.vintage:junit-vintage-engine from 5.10.1 to 5.10.2 by @dependabot in #899
  • Update hashicorp/aws requirement from ~> 5.31.0 to ~> 5.50.0 in /terraform by @dependabot in #813

Known bugs and possible work arounds: known bugs in v3.4.1

Full Changelog: v3.4.1...v3.5.1

validate v3.4.1

14 Dec 00:25
Compare
Choose a tag to compare

What's Changed

Dependency and Technical Updates

  • Add secrets detection by @nutjob4life in #770
  • Bump org.apache.commons:commons-lang3 from 3.13.0 to 3.14.0 by @dependabot in #772
  • Update hashicorp/aws requirement from ~> 5.26.0 to ~> 5.29.0 in /terraform by @dependabot in #777
  • Bump actions/setup-java from 3 to 4 in /.github/workflows by @dependabot in #776
  • Bump org.apache.logging.log4j:log4j-core from 2.21.1 to 2.22.0 by @dependabot in #771
  • Bump docker/setup-qemu-action from 2 to 3 in /.github/workflows by @dependabot in #788
  • Bump docker/setup-buildx-action from 2 to 3 in /.github/workflows by @dependabot in #791
  • Bump docker/build-push-action from 3 to 5 in /.github/workflows by @dependabot in #789
  • Update hashicorp/aws requirement from ~> 5.29.0 to ~> 5.30.0 in /terraform by @dependabot in #786
  • Bump docker/login-action from 2 to 3 in /.github/workflows by @dependabot in #790
  • Bump org.junit.vintage:junit-vintage-engine from 5.7.0 to 5.10.1 by @dependabot in #787
  • Bump commons-cli:commons-cli from 1.5.0 to 1.6.0 by @dependabot in #778
  • Bump com.google.guava:guava from 30.1.1-jre to 32.0.0-jre by @dependabot in #792
  • process both min/max by @al-niessner in #794

Known bugs and possible work arounds: known bugs in v3.4.1

Full Changelog: v3.3.3...v3.4.1

validate v3.4.0

13 Dec 23:24
Compare
Choose a tag to compare
Tag release v3.4.0

validate v3.3.3

20 Nov 23:46
Compare
Choose a tag to compare

What's Changed

  • Re-enable internal reference checking within a bundle on the file system by @al-niessner in #762
  • Fix validate.bat java execution bug by @jordanpadams in #764
  • Refactoring to fix auto detected coding issues by @al-niessner in #699
  • Update site docs with improved Windows install info by @jordanpadams in #725
  • Fix bug where precision is not calculated correctly with whitespace in field by @al-niessner in #721
  • Update to handle spaces in directory names by @al-niessner in #746
  • Add PDS label file paths and manifest files as additional possible inputs by @al-niessner in #745
  • Fix offset calculation bug handling multiple file areas by @al-niessner in #756
  • Improvements for reference integrity checking for large collection inventories (~>100MB) by @al-niessner in #751
  • Update regex for various date times per CCB-350 by @al-niessner in #626
  • Add support to utilize both online and local schema/schematron files by @al-niessner in #632
  • Add WARNING for schema/schematron version mismatch by @al-niessner in #634
  • Throw WARNING when encountering non-standard file extensions for common document encoding types by @al-niessner in #635
  • loosen restriction on required bundle/collection file naming by @al-niessner in #637
  • Fix issues with specific content type not detected correctly by @al-niessner in #639
  • Add units tests for supporting additional data types by @al-niessner in #641
  • add additional test to verify last line of character tables are being validated by @al-niessner in #642
  • remove context product name case sensitivity check by @al-niessner in #638
  • Updates for including data object names in error messages and enhance test suite with additional table types by @al-niessner in #640
  • update ascii file specification regex to more accurately support standards spec by @al-niessner in #636
  • Detect duplicate lidvids in bundle/collection inventories by @al-niessner in #645
  • Update to allow NaNs for IEEE754 data types by @al-niessner in #646
  • Add support for Complex data types by @al-niessner in #650
  • fix bug introduced that erroneously skips products by @al-niessner in #653
  • Handle bundle/collection files as input with bundle/collection rule by @al-niessner in #656
  • Initial validation checks that filenames match valid audio/video formats per CCB-325 by @al-niessner in #647
  • Add product metadata check audio/video files by @al-niessner in #665
  • New --pdf-errors flag to enable error output to user-specified directory by @al-niessner in #666
  • Add documentation for validate-refs utility and start switch to Markdown docs by @jordanpadams in #667
  • Fix bug for PDF errors identifying wrong files by @al-niessner in #668
  • Update special constants validation to support bit patterns by @al-niessner in #669
  • Terraform scripts and documentation to deploy ECS Task Definition for PDS Validate Tool by @ramesh-maddegoda in #672
  • Fix bug finding bundle labels in directory containing both bundles and collections by @al-niessner in #677
  • Add integer types to array processing by @al-niessner in #676
  • Update special constant min/max excursion error to be warning by @al-niessner in #678
  • Add warning about out of order data objects by @al-niessner in #685
  • Bug fix for checking delimited tables that define an object_length by @al-niessner in #687
  • More concise error message when possible record_length mismatch by @al-niessner in #688
  • Check that files with label extension are actually labels to avoid errors on floating XML files by @al-niessner in #689
  • New --complete-descriptions flag to warn for data not described by metadata in label by @al-niessner in #686
  • Add additional support for supporting ways for representing special constants (e.g. -0.9999E+01) by @al-niessner in #692
  • Upgrade verapdf to 2.4.0 and switchover to Greenfield Foundry libraries by @jordanpadams in #694

Dependency Updates

  • Update hashicorp/aws requirement from ~> 5.24.0 to ~> 5.25.0 in /terraform by @dependabot in #758
  • Update hashicorp/aws requirement from ~> 4.0.0 to ~> 5.20.0 in /terraform by @dependabot in #730
  • Update hashicorp/aws requirement from ~> 5.20.0 to ~> 5.21.0 in /terraform by @dependabot in #732
  • Bump actions/checkout from 3 to 4 in /.github/workflows by @dependabot in #700
  • Bump org.apache.maven.plugins:maven-site-plugin from 4.0.0-M8 to 4.0.0-M9 by @dependabot in #706
  • Bump org.apache.maven.plugins:maven-jar-plugin from 3.2.0 to 3.3.0 by @dependabot in #705
  • Bump org.apache.commons:commons-compress from 1.21 to 1.24.0 by @dependabot in #715
  • Bump org.slf4j:slf4j-nop from 1.7.28 to 2.0.9 by @dependabot in #718
  • Bump org.apache.maven.plugins:maven-assembly-plugin from 3.3.0 to 3.6.0 by @dependabot in #714
  • Bump commons-cli:commons-cli from 1.4 to 1.5.0 by @dependabot in #720
  • Bump net.sf.saxon:Saxon-HE from 9.9.1-7 to 12.3 by @dependabot in #701
  • Revert "Bump net.sf.saxon:Saxon-HE from 9.9.1-7 to 12.3" by @jordanpadams in #733
  • Update hashicorp/aws requirement from ~> 4.0.0 to ~> 5.22.0 in /terraform by @dependabot in #738
  • Fix bug in #681 test by @jordanpadams in #740
  • Fix intermittent bug with reading schematrons per Saxon upgrade by @al-niessner in #742
  • Update hashicorp/aws requirement from ~> 5.22.0 to ~> 5.23.1 in /terraform by @dependabot in #744
  • Bump commons-io:commons-io from 2.7 to 2.15.0 by @dependabot in #743
  • Bump org.apache.maven.plugins:maven-site-plugin from 4.0.0-M9 to 4.0.0-M11 by @dependabot in #752
  • Bump org.apache.commons:commons-lang3 from 3.9 to 3.13.0 by @dependabot in #731
  • Bump org.apache.logging.log4j:log4j-core from 2.20.0 to 2.21.1 by @dependabot in #757
  • Upgrade net.sf.saxon:Saxon-HE from 9.9.1-7 to 12.3 by @al-niessner in #734
  • Update hashicorp/aws requirement from ~> 5.23.1 to ~> 5.24.0 in /terraform by @dependabot in #753
  • Update hashicorp/aws requirement from ~> 5.25.0 to ~> 5.26.0 in /terraform by @dependabot in #768
  • Bump org.apache.commons:commons-compress from 1.24.0 to 1.25.0 by @dependabot in #767
  • Bump org.apache.maven.plugins:maven-surefire-plugin from 3.0.0-M3 to 3.2.2 by @dependabot in #766

Known bugs and possible work arounds: known bugs in v3.3.3

Full Changelog: v3.3.0...v3.3.3

validate v3.3.1

15 Nov 03:09
Compare
Choose a tag to compare

What's Changed

  • Refactoring to fix auto detected coding issues by @al-niessner in #699
  • Update site docs with improved Windows install info by @jordanpadams in #725
  • Fix bug where precision is not calculated correctly with whitespace in field by @al-niessner in #721
  • Update to handle spaces in directory names by @al-niessner in #746
  • Add PDS label file paths and manifest files as additional possible inputs by @al-niessner in #745
  • Fix offset calculation bug handling multiple file areas by @al-niessner in #756
  • Improvements for reference integrity checking for large collection inventories (~>100MB) by @al-niessner in #751
  • Update regex for various date times per CCB-350 by @al-niessner in #626
  • Add support to utilize both online and local schema/schematron files by @al-niessner in #632
  • Add WARNING for schema/schematron version mismatch by @al-niessner in #634
  • Throw WARNING when encountering non-standard file extensions for common document encoding types by @al-niessner in #635
  • loosen restriction on required bundle/collection file naming by @al-niessner in #637
  • Fix issues with specific content type not detected correctly by @al-niessner in #639
  • Add units tests for supporting additional data types by @al-niessner in #641
  • add additional test to verify last line of character tables are being validated by @al-niessner in #642
  • remove context product name case sensitivity check by @al-niessner in #638
  • Updates for including data object names in error messages and enhance test suite with additional table types by @al-niessner in #640
  • update ascii file specification regex to more accurately support standards spec by @al-niessner in #636
  • Detect duplicate lidvids in bundle/collection inventories by @al-niessner in #645
  • Update to allow NaNs for IEEE754 data types by @al-niessner in #646
  • Add support for Complex data types by @al-niessner in #650
  • fix bug introduced that erroneously skips products by @al-niessner in #653
  • Handle bundle/collection files as input with bundle/collection rule by @al-niessner in #656
  • Initial validation checks that filenames match valid audio/video formats per CCB-325 by @al-niessner in #647
  • Add product metadata check audio/video files by @al-niessner in #665
  • New --pdf-errors flag to enable error output to user-specified directory by @al-niessner in #666
  • Add documentation for validate-refs utility and start switch to Markdown docs by @jordanpadams in #667
  • Fix bug for PDF errors identifying wrong files by @al-niessner in #668
  • Update special constants validation to support bit patterns by @al-niessner in #669
  • Terraform scripts and documentation to deploy ECS Task Definition for PDS Validate Tool by @ramesh-maddegoda in #672
  • Fix bug finding bundle labels in directory containing both bundles and collections by @al-niessner in #677
  • Add integer types to array processing by @al-niessner in #676
  • Update special constant min/max excursion error to be warning by @al-niessner in #678
  • Add warning about out of order data objects by @al-niessner in #685
  • Bug fix for checking delimited tables that define an object_length by @al-niessner in #687
  • More concise error message when possible record_length mismatch by @al-niessner in #688
  • Check that files with label extension are actually labels to avoid errors on floating XML files by @al-niessner in #689
  • New --complete-descriptions flag to warn for data not described by metadata in label by @al-niessner in #686
  • Add additional support for supporting ways for representing special constants (e.g. -0.9999E+01) by @al-niessner in #692
  • Upgrade verapdf to 2.4.0 and switchover to Greenfield Foundry libraries by @jordanpadams in #694

Dependency Updates

  • Update hashicorp/aws requirement from ~> 5.24.0 to ~> 5.25.0 in /terraform by @dependabot in #758
  • Update hashicorp/aws requirement from ~> 4.0.0 to ~> 5.20.0 in /terraform by @dependabot in #730
  • Update hashicorp/aws requirement from ~> 5.20.0 to ~> 5.21.0 in /terraform by @dependabot in #732
  • Bump actions/checkout from 3 to 4 in /.github/workflows by @dependabot in #700
  • Bump org.apache.maven.plugins:maven-site-plugin from 4.0.0-M8 to 4.0.0-M9 by @dependabot in #706
  • Bump org.apache.maven.plugins:maven-jar-plugin from 3.2.0 to 3.3.0 by @dependabot in #705
  • Bump org.apache.commons:commons-compress from 1.21 to 1.24.0 by @dependabot in #715
  • Bump org.slf4j:slf4j-nop from 1.7.28 to 2.0.9 by @dependabot in #718
  • Bump org.apache.maven.plugins:maven-assembly-plugin from 3.3.0 to 3.6.0 by @dependabot in #714
  • Bump commons-cli:commons-cli from 1.4 to 1.5.0 by @dependabot in #720
  • Bump net.sf.saxon:Saxon-HE from 9.9.1-7 to 12.3 by @dependabot in #701
  • Revert "Bump net.sf.saxon:Saxon-HE from 9.9.1-7 to 12.3" by @jordanpadams in #733
  • Update hashicorp/aws requirement from ~> 4.0.0 to ~> 5.22.0 in /terraform by @dependabot in #738
  • Fix bug in #681 test by @jordanpadams in #740
  • Fix intermittent bug with reading schematrons per Saxon upgrade by @al-niessner in #742
  • Update hashicorp/aws requirement from ~> 5.22.0 to ~> 5.23.1 in /terraform by @dependabot in #744
  • Bump commons-io:commons-io from 2.7 to 2.15.0 by @dependabot in #743
  • Bump org.apache.maven.plugins:maven-site-plugin from 4.0.0-M9 to 4.0.0-M11 by @dependabot in #752
  • Bump org.apache.commons:commons-lang3 from 3.9 to 3.13.0 by @dependabot in #731
  • Bump org.apache.logging.log4j:log4j-core from 2.20.0 to 2.21.1 by @dependabot in #757
  • Upgrade net.sf.saxon:Saxon-HE from 9.9.1-7 to 12.3 by @al-niessner in #734
  • Update hashicorp/aws requirement from ~> 5.23.1 to ~> 5.24.0 in /terraform by @dependabot in #753

Known bugs and possible work arounds: known bugs in v3.3.0

Full Changelog: v3.3.0...v3.3.1

validate v3.3.0

25 Sep 18:21
Compare
Choose a tag to compare

What's Changed

  • Update regex for various date times per CCB-350 by @al-niessner in #626
  • Add support to utilize both online and local schema/schematron files by @al-niessner in #632
  • Add WARNING for schema/schematron version mismatch by @al-niessner in #634
  • Throw WARNING when encountering non-standard file extensions for common document encoding types by @al-niessner in #635
  • loosen restriction on required bundle/collection file naming by @al-niessner in #637
  • Fix issues with specific content type not detected correctly by @al-niessner in #639
  • Add units tests for supporting additional data types by @al-niessner in #641
  • add additional test to verify last line of character tables are being validated by @al-niessner in #642
  • remove context product name case sensitivity check by @al-niessner in #638
  • Updates for including data object names in error messages and enhance test suite with additional table types by @al-niessner in #640
  • update ascii file specification regex to more accurately support standards spec by @al-niessner in #636
  • Detect duplicate lidvids in bundle/collection inventories by @al-niessner in #645
  • Update to allow NaNs for IEEE754 data types by @al-niessner in #646
  • Add support for Complex data types by @al-niessner in #650
  • fix bug introduced that erroneously skips products by @al-niessner in #653
  • Handle bundle/collection files as input with bundle/collection rule by @al-niessner in #656
  • Initial validation checks that filenames match valid audio/video formats per CCB-325 by @al-niessner in #647
  • Add product metadata check audio/video files by @al-niessner in #665
  • New --pdf-errors flag to enable error output to user-specified directory by @al-niessner in #666
  • Add documentation for validate-refs utility and start switch to Markdown docs by @jordanpadams in #667
  • Fix bug for PDF errors identifying wrong files by @al-niessner in #668
  • Update special constants validation to support bit patterns by @al-niessner in #669
  • Terraform scripts and documentation to deploy ECS Task Definition for PDS Validate Tool by @ramesh-maddegoda in #672
  • Fix bug finding bundle labels in directory containing both bundles and collections by @al-niessner in #677
  • 674: add integer types to array processing by @al-niessner in #676
  • Update special constant min/max excursion error to be warning by @al-niessner in #678
  • Add warning about out of order data objects by @al-niessner in #685
  • Bug fix for checking delimited tables that define an object_length by @al-niessner in #687
  • More concise error message when possible record_length mismatch by @al-niessner in #688
  • Check that files with label extension are actually labels to avoid errors on floating XML files by @al-niessner in #689
  • New --complete-descriptions flag to warn for data not described by metadata in label by @al-niessner in #686
  • Add additional support for supporting ways for representing special constants (e.g. -0.9999E+01) by @al-niessner in #692
  • Upgrade verapdf to 2.4.0 and switchover to Greenfield Foundry libraries by @jordanpadams in #694

Full Changelog: v3.2.0...v3.3.0

Known bugs and possible work arounds: known bugs in v3.3.0

validate v3.2.0

14 Apr 00:56
Compare
Choose a tag to compare

Release Highlights

Enhancements

  • #1: new command-line option to support content validation for every N products by @al-niessner in #587
  • New validate-refs command-line tool to check system referential integrity using the Registry by @al-niessner in #600

Bug Fixes

Other Notable Changes

Dependency Upgrades

New Contributors

Full Changelog: v3.1.1...v3.2.0

validate v3.1.1

03 Jan 23:10
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Code Changelog: v3.0.3...v3.1.1