v0.2.8

Released on March 29, 2023.

Enhancements

• Extends Aqueduct's parameter support to allow parameters to be None if
  there is a default value for the parameter in the function definition.
• Tweaks the design of the workflow details page to reduce the number of shades
  of blue.
• Updates SQL query parametrization scheme to use $1, $2, etc. as parameter
  placeholders rather than the previous { param } syntax. This allows a
  paramter to be reused multiple times within the same query and is similar
  to how traditional RDBMS interfaces work.
• Adds context about the execution configuration of an operator to the workflow
  details page. Now, each operator will show the logo of the engine on which
  its running.

Bugfixes

• Fixes bug where the metric history graph's X-axis would not reflect
  timescales; all data points would be evenly spaced out rather than
  reflecting the amount of time between each point.
• Fixes bug where cross-environment Python requirements gathering would lead to
  erroneous installation. Currently, Aqueduct only supports explicit
  requirements specification.
• Fixes bug where certain workflow failures would leave unfinished operators in
  an infinitely-pending state; now, nodes are correctly marked as canceled.
• Fixes bug where retrieving a non-existent filepath from S3 would return
  succesfully but with empty data; now, a detailed error message is shown
  instead.
• Fixes bug where attempting to capture a system metric would thrown an error.

All Changes

v0.2.7...v0.2.8

All commits

• Changelog typo fix by @cw75 in #1131
• Fix ondemand k8s doc link by @cw75 in #1132
• Set up demo codespace by @likawind in #1122
• ENG-2622 Show metrics history graph temporally on the x axis. by @agiron123 in #1133
• Remove gathering requirements from user environment by @jpurusho65 in #1123
• Eng 2441 Update node statuses to cancel when workflow run is finished by @eunice-chan in #1129
• ENG-2537 Adds DAG Layout Test Cases by @agiron123 in #1128
• Add an empty requirements.txt files by @jpurusho65 in #1140
• Create implicit parameters with the default value being what's specified in the function signature by @cw75 in #1141
• [ENG-2687] Reduce the number of shades of blue on workflow details page by @vsreekanti in #1142
• Fix sql query parameterization bug using $1, $2 placeholders by @kenxu95 in #1134
• [ENG-2676] Show operator context on nodes by @vsreekanti in #1121
• Adds support for bigquery integration tests by @saurav-c in #1136
• Fix bug where using S3 integration with non-existent filepath succeeds by @Fanjia-Yan in #1070
• Add system_metric function to GenericArtifact by @hsubbaraj-spiral in #1138
• Fix bug with ExecuteWorkflow and DatabricksJobs by @hsubbaraj-spiral in #1143
• Reframe README to match latest positioning by @vsreekanti in #1114
• Release 0.2.8 by @eunice-chan in #1147