v3.00.53pre2 - Cloud Transfers Enabled

• Introduces (experimental) S3 and Azure Transfer classes (native support for polling and transfer to and from cloud storage.) from (@gcglinton !). but also many other improvements.
• heavily re-factored and improved AM server.
• heavily re-factored poll
• improvements in callback api.

What's Changed

• Add topicPrefix to docs to fix #961 by @reidsunderland in #964
• Fixed "Downloading using CLI" tutorial page by @mshak2 in #962
• Remove threading from AMQP Consumer code by @reidsunderland in #965
• Run housekeeping during long sleeps by @reidsunderland in #969
• fix #967 define hostname as a string option, and stuff works by @petersilva in #970
• Add missing tokIsYear method from Sundew. Prevents some erronous bulletins not being filtered. by @andreleblanc11 in #973
• fix #971 Add missing to list of possible process status by @petersilva in #972
• Re-enable AMQP consumer flow tests by @reidsunderland in #977
• Reject float types for Julian day value in getTime by @andreleblanc11 in #979
• Housekeeping logging changes by @reidsunderland in #978
• Rename tests to have consistent naming by @reidsunderland in #981
• Add S3 Sender plugin by @reidsunderland in #983
• NASA PODAAC checksum change by @reidsunderland in #988
• Issue986 - stop converting directory to path in poll. by @petersilva in #987
• Issue992 - re-parse values using correct type for add_options from flow_callbacks. by @petersilva in #999
• No download message when not downloading by @petersilva in #998
• fix #982 by checking for statehost in cleanup by @petersilva in #996
• Issue994 unit tests broken and failing alot (but weirdly not always.) by @petersilva in #995
• Clarify a bit more how each component works in the documentation by @andreleblanc11 in #993
• Issue997 - Eliminate retry file race condition and make AM work more like a sarracenia flow by @andreleblanc11 in #1005
• Issue974 yet another scheduled_poll refactor PR by @petersilva in #991
• Transfer documentation and a fix for all tests... by @petersilva in #1009
• #982 statehost config option should be used to see pick state directory by @petersilva in #1003
• Native S3 transfer driver by @gcglinton in #1010
• Make persistent a configurable option (sr3) by @reidsunderland in #1013
• Azure transfer driver by @gcglinton in #1019
• EUMETSAT poll plugin update by @reidsunderland in #1027
• implement topicCopy for #1023 by @petersilva in #1025
• fix #947, only report on .conf or .inc files by @petersilva in #1014
• Issue1022 by @petersilva in #1024
• Wis2 integration - MQTT publishing using sr3 stack by @mshak2 in #1026
• Issue1029 wmo00 accumulated file format support by @petersilva in #1030
• Issue908 - Improve general am/gather code and properly kill children zombies. by @andreleblanc11 in #1031
• flakey flow test failing when polls killed with -9 cannot remove novip state file by @petersilva in #1032
• Issue980 - Add verifyHeader method to prevent erronous headers from passing through by @andreleblanc11 in #1033
• updatePaths work without being supplied new_dir and new_path by @petersilva in #1034
• locally installed plugins are not selected because we prepend system … by @petersilva in #1038
• Exchange split override by @petersilva in #1041
• updatePaths no longer fails when called with just options by @petersilva in #1039
• Better sender io errors (download also...) by @petersilva in #1037

Full Changelog: v3.00.52...v3.00.53pre2

https://metpx.github.io/sarracenia/Tutorials/Install.html

Packages Available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx-pre-release

PyPI: https://pypi.org/project/metpx-sr3/3.0.53rc2/

• (Coming Soon) RPM package for fedora core 39 (fc39)

• RPM package for Redhat Enterprise Linux Version 8.9 (rhel8_9) attached here, install with rpm -ivh ... note:

  • Some dependencies are not readily available. May have to obtain packages
    from pip to get a fully functional installation. Verify with sr3 features after installation, to determine if everything needed is available.

• self-extracting windows installer also attached.