v0.29.1

The present patch release improves some debug output in the O² Bookkeeping integration client.

• [core] Print debug message to IL on Bookkeeping client calls

v0.29.0

The present release brings important improvements in the template system and in the ODC client, adding support for the PDP panel in the GUI and the EPN processing script generator.

• Template improvements:
  • [core] Add ObjectStack + CallStack to plugin system
  • [core] Support script vs topology alternatives in ODC calls
  • [core] Implementation of GenerateEPNWorkflowScript + usage in Configure
  • [core] Add missing initialization in ODC plugin
  • [core] Ensure all plugin functions are deep-copied into template context
  • [core] Improve EPN script generator default behaviour
  • [core] Use default as default string for PDP detector lists

v0.28.0

This release brings improvements to AliECS, a cleanup mechanism for the TRG (formerly CTP) integration plugin and minified versions of some API calls. It also brings a new feature, hook weights, which allows a workflow author to append a + or - signed integer to trigger and await expressions to make call execution sequential.

• Minified API:

  • [core][coconut] Add minification switches to GetEnvs/GetEnv calls

• DCS cleanup fix:

  • [core] Improve DCS client logging and run number cache
  • [core] Greedy run number caching in DCS client
  • [core] Track DCS operation status for each detector

• TRG integration plugin:

  • [core] Trigger client run number cache and Cleanup function
  • [core] The ctp plugin is now called trg

• Hook weight index:

  • [core] Support weight in hook target/await expressions
  • [core] New plugin "testplugin" with call testplugin.Noop()
  • [core] Ensure the testplugin can be loaded
  • [core] Fix hook call weights list generation

v0.27.80

This release brings improvements to AliECS, a cleanup mechanism for the TRG (formerly CTP) integration plugin and minified versions of some API calls.

• Minified API:

  • [core][coconut] Add minification switches to GetEnvs/GetEnv calls

• TRG integration plugin:

  • [core] Improve DCS client logging and run number cache
  • [core] Trigger client run number cache and Cleanup function
  • [core] The ctp plugin is now called trg

v0.27.1

The present patch release in the v0.27 series brings important improvements to the AliECS core, including ODC integration facilities and hook handling.

• [core] Improve debug output of ODC cleanup operations
• [core] Relax locking in environment manager
• [core] Improve thread safety in task manager class cache
• [core] Only query for active ODC partitions, and immediately Shutdown
• [core] Parallelize ODC Shutdown calls during cleanup
• [core] Parallelize AwaitAll in hook call processing
• [core] Send run number in ODC Start/Stop calls
• [core] Also send run number to ODC in SetProperties call

v0.27.0

This release brings major improvements to AliECS, including an overhaul of timeouts and locking in the AliECS core, CTS (trigger system) integration, and improvements to Bookkeeping integration and other integration facilities.

• Core locking and timeouts:

  • [core] Improve error response consolidation and mutex granularity
  • [core] Improve mutex granularity in environment manager
  • [core] Declare offending roles in failed DEPLOY transition
  • [core] Correctly report nil error if no tasks failed to CONFIGURE
  • [core] Expose call traits (including timeout) to called function
  • [core] Return inline error of the correct type
  • [core] Don't crash when parsing error on MesosCommandResponse

• Integration:

  • [core] Bookkeeping get JWT from consul
  • [core] Ensure all ODC calls are bound by a context with timeout
  • [core] Move acquireTimeout utility function to the callable package
  • [core] Ensure all DCS calls are bound by a context with timeout
  • [core] Ensure all DDsched calls are bound by a context with timeout
  • [core] Adjust level of DCS client log messages
  • [core] Forward ODC error messages
  • [core] Pass detectors to Bookkeeping API
  • [core] Pass any var ddsched_ to DD scheduler as param
  • [core] Pass any var odc_ to ODC except known named params
  • [core] Update ODC protofile
  • [core] Make environment.Manager single instance accessible from outside
  • [core] New cleanup facilities for ODC

• CTS/CTP integration plugin:

  • [core] Add ctpecs protos
  • [core] Create CTS client
  • [core] Create CTS plugin
  • [core] Register CTS plugin
  • [core] CTS plugin cleanup debug messages
  • [core] Update ctp proto file
  • [core] Rename cts to ctp
  • [core] Add RunUnload and extend logic for the remaining ones
  • [core] CTP run start read config from consul
  • [core] Add GetRuntimeConfig func in templates
  • [core] CTP get global config

• Miscellaneous:

  • [build] Minor go.mod adjustment
  • [core] Improve logging in env.handleHooks
  • [core] Reduce verbosity of recurrent log messages
  • [executor] Remove excessive debug output
  • [executor] Fix MesosCommandResponse error handling

v0.26.82

This release brings major improvements to AliECS, including an overhaul of timeouts and locking in the AliECS core, CTS (trigger system) integration, and improvements to Bookkeeping integration and other integration facilities.

• Core locking and timeouts:

  • [core] Improve error response consolidation and mutex granularity
  • [core] Improve mutex granularity in environment manager
  • [core] Declare offending roles in failed DEPLOY transition
  • [core] Correctly report nil error if no tasks failed to CONFIGURE
  • [core] Expose call traits (including timeout) to called function
  • [core] Return inline error of the correct type
  • [core] Don't crash when parsing error on MesosCommandResponse

• Integration:

  • [core] Bookkeeping get JWT from consul
  • [core] Ensure all ODC calls are bound by a context with timeout
  • [core] Move acquireTimeout utility function to the callable package
  • [core] Ensure all DCS calls are bound by a context with timeout
  • [core] Ensure all DDsched calls are bound by a context with timeout
  • [core] Adjust level of DCS client log messages
  • [core] Forward ODC error messages
  • [core] Pass detectors to Bookkeeping API

• CTS integration plugin:

  • [core] Add ctpecs protos
  • [core] Create CTS client
  • [core] Create CTS plugin
  • [core] Register CTS plugin
  • [core] CTS plugin cleanup debug messages
  • [core] Update ctp proto file
  • [core] Rename cts to ctp
  • [core] Add RunUnload and extend logic for the remaining ones
  • [core] CTP run start read config from consul
  • [core] Add GetRuntimeConfig func in templates

• Miscellaneous:

  • [build] Minor go.mod adjustment
  • [core] Improve logging in env.handleHooks
  • [core] Reduce verbosity of recurrent log messages
  • [executor] Remove excessive debug output
  • [executor] Fix MesosCommandResponse error handling

v0.26.81

This release brings major improvements to AliECS, including an overhaul of timeouts and locking in the AliECS core, CTS (trigger system) integration, and improvements to Bookkeeping integration and other integration facilities.

• Core locking and timeouts:

  • [core] Improve error response consolidation and mutex granularity
  • [core] Improve mutex granularity in environment manager
  • [core] Declare offending roles in failed DEPLOY transition
  • [core] Correctly report nil error if no tasks failed to CONFIGURE
  • [core] Expose call traits (including timeout) to called function
  • [core] Return inline error of the correct type
  • [core] Don't crash when parsing error on MesosCommandResponse

• Integration:

  • [core] Bookkeeping get JWT from consul
  • [core] Ensure all ODC calls are bound by a context with timeout
  • [core] Move acquireTimeout utility function to the callable package
  • [core] Ensure all DCS calls are bound by a context with timeout
  • [core] Ensure all DDsched calls are bound by a context with timeout
  • [core] Adjust level of DCS client log messages
  • [core] Forward ODC error messages

• CTS integration plugin:

  • [core] Add ctpecs protos
  • [core] Create CTS client
  • [core] Create CTS plugin
  • [core] Register CTS plugin
  • [core] CTS plugin cleanup debug messages
  • [core] Update ctp proto file
  • [core] Rename cts to ctp
  • [core] Add RunUnload and extend logic for the remaining ones
  • [core] CTP run start read config from consul
  • [core] Add GetRuntimeConfig func in templates

• Miscellaneous:

  • [build] Minor go.mod adjustment
  • [core] Improve logging in env.handleHooks
  • [core] Reduce verbosity of recurrent log messages
  • [executor] Remove excessive debug output
  • [executor] Fix MesosCommandResponse error handling

v0.26.80

This release brings major improvements to AliECS, including an overhaul of timeouts and locking in the AliECS core and improvements to Bookkeeping integration and other integration facilities.

• Core locking and timeouts:

  • [core] Improve error response consolidation and mutex granularity
  • [core] Improve mutex granularity in environment manager
  • [core] Declare offending roles in failed DEPLOY transition
  • [core] Correctly report nil error if no tasks failed to CONFIGURE
  • [core] Expose call traits (including timeout) to called function

• Integration:

  • [core] Bookkeeping get JWT from consul
  • [core] Ensure all ODC calls are bound by a context with timeout
  • [core] Move acquireTimeout utility function to the callable package
  • [core] Ensure all DCS calls are bound by a context with timeout
  • [core] Ensure all DDsched calls are bound by a context with timeout

• Miscellaneous:

  • [build] Minor go.mod adjustment
  • [core] Improve logging in env.handleHooks
  • [core] Reduce verbosity of recurrent log messages
  • [executor] Remove excessive debug output
  • [executor] Fix MesosCommandResponse error handling

v0.26.7

This is a patch release for the AliECS v0.26 series, bringing an updated Bookkeeping API interface, changes in the repo ssh auth operation along with documentation updates.

• bookkeeping:
  * [core] Add epn_topology for Bookkeeping
• repo:
  • [repo] Disable strict host checking for ssh auth
• misc:
  • [misc] Update documentation URLs
• apricot:
  • [apricot] The documentaton to explain how to use the TCE is created.
  • [apricot] The documentation for the apricot TCE has concrete examples.