v3.00.57 - closer to fine

Summary

"The less I seek my source for some definitive, the closer I am to fine." -- Indigo Girls.

The last version (3.0.56) was the first one where we thought sr3 could replace any
v2 configuration. As we did so, a few new regressions were found in some senders.
This release addresses all of those. We are close to there being none left.

There are also improvements in this release:

• #1350 Add “down” and “disconnected” run states to sr3 status
• #1323 DESTFN=NONE::TIME now works.
• #1299 after_gather entry point added.
• #1289 accept statements now provide arguments to plugins
• change in post_exchangeSplit… now based on relPath, not checksum. (work on HPC.)
• fix #1241 sr3 status more compact.
• fix #1206 exclude retries from lag calculation.
• #1301 sr3 status display fractional message rates when (< 1 / second.)
• user mode systemd unit file now tested and working.
• The https://dd.weather.gc.ca web site was revised. Example subscriptions revised to match.
• #1346 warn that queue parameters should be earlier in configs now.
• #1358 date/time duration breakage by @petersilva in #1359

Regressions compared to v2 that are fixed:

• #1337 mirror per umask, not global (sender)
• #1340 rename not working. (sender)
• #1327 inflight NONE in sender causes messages to be retried. (sender)
• #1322 sr3 sender fails to post message when no identity field in message.
• #1351 fixing problem getting local checksums of data that has arbitrary identity method by @petersilva in #1362

HPC mirroring related fixes:

• fix #1363 hardlink support broken. by @petersilva in #1364
• fix #1366 ln -sf leaving tmp files lying around by @petersilva in #1367
• review and improve error handling when invoking makedirs by @petersilva in #1365
• #1297 part2 ordering mdelaylatest by @petersilva in #1368

What's Changed

• 3.00.54 maint by @petersilva in #1179
• got github notice about artifact@v3 being obsoleted by @petersilva in #1287
• Fix issue #1241 - make sr3 status display more compact by @mshak2 in #1290
• Add fileSizeMax to sender #1285 by @andreleblanc11 in #1286
• Check if there is anything to retry before figuring out if we by @petersilva in #1292
• systemd integration hints were v2 oriented by @petersilva in #1293
• Add method to recycle unused instance numbers #1288 by @andreleblanc11 in #1294
• Issue339 try5 fail connections in main loop by @petersilva in #1295
• issue #624 adding INSTANCE to variable substitution by @petersilva in #1296
• Issue634 design documentation review by @petersilva in #1303
• fix #1206 change send signature to support permanent failures by @petersilva in #1305
• Implement #1289 by @reidsunderland in #1306
• Fix #1307 - Decrease info-message length for sr3 cleanup by @mshak2 in #1313
• Fix #1301 by @mshak2 in #1312
• Fix #1309 by @andreleblanc11 in #1310
• exclude retries from lag accumulation by @petersilva in #1304
• Issue1299 - New after_gather entry point + better error handling in sundew_dirPattern by @andreleblanc11 in #1308
• user mode systemctl start should not setuid/setgid by @petersilva in #1317
• get DESTFN=NONE::TIME to work... I think. by @petersilva in #1323
• Fix #1321, allow any component's default_options overrides to work by @reidsunderland in #1326
• Issue1322 post exchange split revamp by @petersilva in #1329
• sender options inflight test fails if None by @petersilva in #1330
• Fix py3.6 crash by re-implementing #1289 by @reidsunderland in #1332
• fix partitions, broken because naturalsize output has no spaces anymore by @petersilva in #1333
• Fix #1325 by handling the exception by @reidsunderland in #1335
• Refactor email plugin config syntax by @reidsunderland in #1338
• Four in 1: Issue #1300 watch file perm, #1316 crash in download decision, #1254 poll fileAgeMin, #1337 mirror is not global by @petersilva in #1336
• fix #1283 disable new config by @petersilva in #1343
• user service cannot depend on multi-user (system) target by @petersilva in #1339
• Many small issues by @petersilva in #1342
• Fixing unit tests 202412 by @petersilva in #1345
• Issue1346 deal with change in semantics for queue declares from previous versions. by @petersilva in #1349
• changing topics for new citypage scheme by @petersilva in #1341
• Fix DiskQueue bugs by @reidsunderland in #1356
• sr3 status fixes #1350 and #1352. by @petersilva in #1355
• Issue1358 date/time duration breakage by @petersilva in #1359
• Add logic from gitlab version of plugins by @andreleblanc11 in #1361
• Issue1351 fixing problem getting local checksums of data that has arbitrary identity method by @petersilva in #1362
• fix #1363 hardlink support broken. by @petersilva in #1364
• fix #1366 ln -sf leaving tmp files lying around by @petersilva in #1367
• review and improve error handling when invoking makedirs by @petersilva in #1365
• Issue1297 part2 ordering mdelaylatest by @petersilva in #1368

Full Changelog: v3.00.56...v3.00.57

Packages Available

(coming soon) Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

PyPI: https://pypi.org/project/metpx-sr3/3.0.57/

• RPM package for Redhat Version 8 (rh8) and 9 (rh9) attached here, install with rpm -ivh ... note:

  • Some dependencies are not readily available. May have to obtain packages
    from pip to get a fully functional installation. Verify with sr3 features after installation, to determine if everything needed is available.

• Experimental self-extracting windows installer also attached. WSL is preferred if possible.