v3.23.11p3 fix bad connection behaviour in consumer.

the constant queue re-declaration (and re-connection to the broker) fixed in this release is almost
a DOS attack on the broker. Really better to not use 11p2.

What's Changed

• fix to match sarra issue #639 relative sftp links by @petersilva in #131
• when used as shovel/winnow, it constantly re-declares the queue. by @petersilva in #132

Full Changelog: v3.23.11p2...3.23.11p3

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

v3.23.11p2

BUG

this release is fine for use for posting (sr3_cpost, and the shim library)

HOWEVER: DO NOT USE sr3_cpump IN THIS RELEASE (the consumer code.)

in sr3_cpump (which is used for consuming from a queue.) there is a small bug that makes it constantly re-connect to the broker when there are no messages ready, making it a badly behaved consumer. It's sort of a DOS attack on the broker, and it will print millions of messages in the log file as well.

Use an earlier or later release (3.23.11p3)

What's Changed

• on #109 consumer connection recovery was broken. by @petersilva in #129
• fix for #127... status core dump by @petersilva in #128

Full Changelog: v3.23.11p1...v3.23.11p2

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

Version 3 mirroring (complete?)

Summary.

The shim library to support HPC mirroring should be completely working at this point.
The consumer (sr3_cpump) is coming along, theis version has metrics support for better sr3 status displays.

What's Changed

• 114 hpc mirroring corruption multiple updates to file with same name getting lost by @petersilva in #115
• file open logic was strange. was testing uninitialized value, no reason. by @petersilva in #116
• Feature move metrics by @petersilva in #117
• fix #109 non blocking message checks, with separate sleep, so houskee… by @petersilva in #123
• fixes #118 management of metrics dir and files by @petersilva in #119
• when config is not found, say where you looked by @petersilva in #124

Full Changelog: v3.23.01...v3.23.11p1

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

latest fixes to support mirroring.

This release includes all work since July (v2.22.07), when the last release was done. Result of ongoing work with Environment and Climate Change Canada client... They have transitioned to sr3, so dropping v2 support, this new release is sr3 only.

in 3.23.01 itself:

• working on #101 moving symlinks results in file, instead of link (only with relpathPost set.)
• fix for #94 (not sure if it covers all cases.)
• mv symlink -> compound fileOp: { "rename":"toto", "link": "target" },
• added CI/CD testing.
• dup memory added, so duped files are closed once.
• print format now looks like v03 messages instead of v2
• realpath_filter defaults to true now.
• removed support for from_cluster, to_cluster
• some variable internal names updated to reflect v2->sr3
• new default: when post_baseUrl use file:/... use /... to set post_baseDir.
• when SR_SHIMDEBUG is set, it automatically turns on logLevel Debug.

metpx-sr3c (3.22.12p1) unstable; urgency=medium

• backported overlooked patch from v2 for SSL errors on redhat 8
• fix coredump on specification of unknown checksum algorithm
• README updated (was unchanged from v2.)

metpx-sr3c (3.22.12) unstable; urgency=medium

• removed some debug prints
• fix: #68 wgrib2 will not post (via libsrshim.) (regression in 3.22.07 now fixed.)
• now only post once for rename case. add v2compatRenameDoublePost support

metpx-sr3c (3.22.11) unstable; urgency=medium

• fix for #103

metpx-sr3c (3.22.09p2) unstable; urgency=medium

• changed v03 format (for symlinks, rename, remove cases.)
• #85 fix for infinite loop on_exit.
• debug messages include pid and wall-clock time offset from start in seconds.
• packaging improvements (separate devel package)
• fixes for #100, and #101 HPC mirroring symlink processing.

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

v2.22.07

• added outlet support for v03 format.
• fix for shim library looping forever when too many exit hooks present.
• refactored/refined shim library debug printing.

versus previous Release made on github (intervening issues
were just used internally.

sarrac (2.22.06p2) stable; urgency=medium

• rpath to ../lib fixing search for dyn libraries.
• put back mv for libsarra.so.1

sarrac (2.22.06p1) stable; urgency=medium

• fix for hang on (GoC internal) hpcr U2 pppX environment.
• fix for crash on (GoC internal) hpfx U2 dtnX environment.
• bugfix coredump for n sum with path in cwd.
• #96 second bugfix for "already running " (race condition on startup)

sarrac (2.22.05) stable; urgency=medium

• #96 bugfix for crash/hang on permissions problems.

sarrac (2.21.02) stable; urgency=medium

• renumbered release because of weird build issue on launchpad metpx-daily
• fix for #93 missing symlinkat(2) and symlinks combined with realpath option.
• fix usage printing had fqdn and action inverted.
• some prep for v03 upward compatibility.

sarrac (2.20.07) stable; urgency=medium

• fix for coredump when a path is set to a non-existe environment variable.
• statehost is now a boolean, as per sr_subscribe man page (core dumped before.)

v2.20.02b3

• adding support for sr_insects (more extensive test data.)
• bugfix #89 bogus message on cpost startup: 'inot init failed: (null)'
• change AMQP message content-type from text/plain to application/json for
  v03 messages (user feedback.)

ubuntu packages available here:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx
or build from source.

v2.19.12b6

• issue #86 guess anonymous:anonymous for broker user.
• issue #87 clean up instance files after one-shot call.
• issue #88 do not post clearly corrupt messages.

ubuntu packages available here:

• Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

or build from source.

v2.19.12b5

Fixes all current irritants.

• issue #71 fixed (apparent message corruption was just a parsing problem.)
• improving some error messages.
• when a message is corrupted, disconnect and reconnect.
• Issue #85 when restarting a component if it wasn't running before, it would not restart.

ubuntu packages available here:

• Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

or build from source.

v2.19.12b2

• now loops forever if binding fails (do not accept failure to bind.)
• fix: #80 systematic cleanup for problem in #76. minimizing overall risk.
• improved debian packaging dependencies.

ubuntu packages available here:

• Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

or build from source.

v2.19.11b2

• fix: #76 crash with libsrshim and sed command.
• new: rpm spec files for Suse and Redhat

ubuntu packages available here:

• Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

or build from source.