v0.40.0

The present release includes a refactor of Bookkeeping integration facilities as a new Bookkeeping integration plugin, fixes to the recently introduced Kafka integration plugin, and other miscellaneous improvements and fixes.

• Bookkeeping integration plugin:

  • [core][OCTRL-621] The Bookkeeping should become an integration plugin to take advantage of hooks.
  • [core][OCTRL-621] Bookkeeping is an integration plugin that can take advantage of hooks.
  • [core][OCTRL-621] Bookkeeping integration plugin related files are cleaned up.
  • [core][OCTRL-621] Resolving PR comments for the Bookkeeping integration plugin.

• Kafka integration plugin:

  • [core] kafkaBroker -> kafkaEndpoint
  • [core] Add kafkaEndpoint as known cli flag
  • [core] Allow auto topic creation in Kafka client + improved logging

• Miscellaneous:

  • [core] Push lhc_period, run_type and detectors to EPN tasks
  • [core] Introduce START counter as __fmq_cleanup_count variable
  • [core] Push cleanup variable (__fairmq_cleanup_count) to FLP and EPN
  • [apricot][OCTRL-547] ListRuntimeEntries returns the correct flattened tree.

v0.39.0

The present release includes fixes to TRG response handling, cleanup facilities, and a new Kafka integration plugin.

• Kafka integration plugin:

  • [core] Kafka plugin to publish FSM state transitions
  • [core] Check if kafka message status can be read
  • [core] Store environment state in varStack and make kafka plugin get it from there
  • [core] Use UnixMilli(), since Go 1.17 supports it
  • [core] Initialize loggers in CCDB and Kafka plugins
  • [core] A different (working) approach to obtaining current state
  • [core] Update kafka topics to the agreed convention
  • [core] rename kafkaBroker to kafkaEndpoint for consistency, fix log
  • [core] Publish an empty env list to kafka at init
  • [core] Publish Error state and react to DESTROY in kafka plugin
  • [core] Use one common callback in the kafka plugin
  • [core] several improvements to logging in kafka and ccdb plugins
  • [core] make some member of kafka plugin private
  • [core] include STANDBY in the states which can initiate GO_ERROR
  • [core] Port kafka plugin to kafka-go package
  • [core] Minor string fixes in kafka plugin

• Other integration plugin fixes:

  • [core] Make TRG RunList line parsing forward-compatible
  • [core] TRG: Improve run parsing
  • [core] TRG should ignore the daq trigger
  • [core] Handle daq & standalone trg reconciliation gracefully

• Miscellaneous:

  • [core] Add dirty hack for FLP cleanup before DEPLOY
  • [core] Properly set facility & partition for shmcleaner logs

v0.38.80

The present release includes fixes to TRG response handling, cleanup facilities, and a new Kafka integration plugin.

• Kafka integration plugin:

  • [core] Kafka plugin to publish FSM state transitions
  • [core] Check if kafka message status can be read
  • [core] Store environment state in varStack and make kafka plugin get it from there
  • [core] Use UnixMilli(), since Go 1.17 supports it
  • [core] Initialize loggers in CCDB and Kafka plugins
  • [core] A different (working) approach to obtaining current state
  • [core] Update kafka topics to the agreed convention
  • [core] rename kafkaBroker to kafkaEndpoint for consistency, fix log
  • [core] Publish an empty env list to kafka at init
  • [core] Publish Error state and react to DESTROY in kafka plugin
  • [core] Use one common callback in the kafka plugin
  • [core] several improvements to logging in kafka and ccdb plugins
  • [core] make some member of kafka plugin private
  • [core] include STANDBY in the states which can initiate GO_ERROR

• Other integration plugin fixes:

  • [core] Make TRG RunList line parsing forward-compatible
  • [core] TRG: Improve run parsing
  • [core] TRG should ignore the daq trigger
  • [core] Handle daq & standalone trg reconciliation gracefully

• Miscellaneous:

  • [core] Add dirty hack for FLP cleanup before DEPLOY
  • [core] Properly set facility & partition for shmcleaner logs

v0.38.02

This release includes automatic trigger cleanup functionality and other trigger-related improvements.

v0.38.01

This release includes a temporary workaround for cleaning up FLP resources during environment creation.

v0.38.1

The present release includes critical improvements to the TRG integration plugin.

• [core] TRG: implement run list query in GetData
• [core] TRG asynchronous GetData + RunList polling + reconciliation

v0.38.0

The present release includes AliECS core API improvements, as well as improvements to multiple client plugins.

• Integration client improvements:

  • [core] Use odc.Status for GetData implementation
  • [core] ODC status polling + GetData from client-side
  • [core] CCDB user-visible string rename
  • [core] ODC user-visible string rename
  • [core] DD user-visible string rename
  • [core] SOR/EOR messages for DCS and TRG improvements

• API improvements:

  • [coconut+core][OCTRL-161-fix] The workflow template descriptions are shown using the templ list command.
  • [core] Attach environment info to outgoing gRPC status on deploy fail

• Miscellaneous:

  • [build] Bump Go version for GitHub build checks
  • [build] Update dependencies
  • [coconut][octrl-180] The nocolor output option is available for all coconut commands.
  • [core] Fix minor log message bugs

v0.37.0

The present release includes AliECS core API improvements, as well as improvements to the ODC client plugin.

• API improvements:

  • [core] Always return EnvironmentInfo with envId on failed deployment
  • [core] Ensure all timestamps sent by AliECS are in milliseconds
  • [core][octrl-210] Timestamps are returned by ControlEnvironment, when launching environment transitions.
  • [core][octrl-210] The start, end and duration of transitions are represented by an int64.
  • [core][octrl-210] The timestamp of an environment's creation is represented by an int64.
  • [core][octrl-210-fix] The proto names of the timestamp variables are uniform with the rest of the code.

• ODC client plugin:

  • [build] Update ODC protofile URL
  • [core] Propagate ODC timeouts to the server side + odc_padding_timeout

• Miscellaneous:

  • [core][octrl-203] An error is returned if the workflow template file name and the workflow name don't match.
  • [core][octrl-203] An error is returned when the task template file name and the task name don't match.
  • [core][octrl-161] The workflow template description is associated with environment info.
  • [core][octrl-161] The workflow template description doesn't need to go through the roles.

NOTE: Starting with AliECS v0.37.0, Go 1.17 or later is required.

v0.36.0

The present release further improves DCS client behaviour and output, reduces the volume of frequent log messages across the board, and brings other minor improvements.

• DCS:

  • [core] More permissive DCS client behaviour
  • [core] Report DeadlineExceeded as timeout error
  • [core] Push detector list to InfoLogger at the beginning of DCS SOR/EOR

• Miscellaneous:

  • [misc] Reduce verbosity of the most vocal log message #31 to #60
  • [apricot] Add getAll flag for ListDetectors RPC
  • [apricot] Regenerate Apricot protobuf code

v0.35.0

The present release further improves integration plugin hook handling and refactors many aspects of TRG, DDsched and DCS integration, and brings miscellaneous fixes and improvements.

• Integration plugins:

  • [core] Correct error reporting from TRG plugin
  • [core] Correct error reporting from DDsched plugin
  • [core] TRG cleanup fix for standalone runs
  • [core] DCS client call handling refactor and miscellaneous fixes

• Miscellaneous:

  • [core] Minor logic fix in ODC integration (behaviour unchanged)
  • [core] Fix END_OF_STREAM log message