v0.2.2

Key Features

• Adds support for receiving Aqueduct notifications via email or in Slack
  workspaces. You can configure notification settings for your Aqueduct
  installation at large, and you can also customize notification settings
  per-workflow. Notifications can be configured to be sent for all workflow
  executions, only on warnings, or only on errors.
  • Email: You can connect Aqueduct to your email account and specify a
    list of email addresses as recipients. Each notification will trigger a
    separate email.
  • Slack: You can connect Aqueduct to your Slack workspace and specify a
    channel that Aqueduct should send notifications on. Each notification
    will send a separate message.

Enhancements

• Adds support for specifying Snowflake schema when creating integration from
  UI.
• Adds support for executing an operator that has one or more parameters and
  multiple outputs interactively. You can call the same function, and
  Aqueduct will automatically override previous implicitly created
  parameters. See our
  documentation for more details.

  @op
  def fn(param):
    return param
  
  res = fn(1).get()
  >>> 1 # Creates a parameter named `param` for you automatically, with a default value of 1.
  
  res = fn(2).get()
  >>> 2 # Updates `param` to have a default value of 2.

Bugfixes

• Fixes two bugs where Aqueduct server was retrieving full data objects from
  the Aqueduct metadata store to check for their existence. When working
  with non-trivial data, this could cause serious performance issues.
• Fixes bug where object does not exist errors from S3 were mishandled, causing
  Aqueduct to surface incorrect errors.
• Fixes bug where pods that are marked as pending on Kubernetes were being
  treated as failed operators.
• Fixes bug where log and stack traces blocks didn't have proper formatting and
  backgrounds on the UI.
• Fixes bug that was causing full data objects to be retrieved repeatedly when
  loading metadata on the UI.
• Fixes bug where UI was previously treating not-yet-executed operators (for an
  in-progress workflow) as failed operators.
• Fixes bug where the SDK's global_config could not be changed to set
  Aqueduct as the compute engine.

All Changes

v0.2.1...v0.2.2

All commits

• ENG-2171 Add Tabs to Workflow Details Page by @agiron123 in #962
• Fix performance issue when using S3 as metadata storage by @cw75 in #973
• Allows user to specify optional Snowflake schema in UI by @saurav-c in #972
• Adds a storage.exists() check to replace extra storage.get() by @hsubbaraj-spiral in #974
• ENG-2285 MySQL Integration Testing Setup by @agiron123 in #960
• ENG-2286 Postgres Integration Test Setup by @agiron123 in #956
• Fix bug in S3 GET error handling and k8s pod status handling by @cw75 in #976
• ENG 2405 Fix bug where log and stack traces divs don't have backgrounds by @eunice-chan in #967
• Fix bug where we are retrieving artifact payloads on workflow page by @cw75 in #978
• Eng 2362 Fix IP address display for common cloud providers by @eunice-chan in #979
• Eng 2284 Integrate MariaDB to Integration Tests by @eunice-chan in #968
• ENG-2453 Dag Width and Height Fixes by @agiron123 in #980
• Pass in jobManager to Operators if shared context is required by @hsubbaraj-spiral in #969
• ENG-2409 TabPanel Component by @agiron123 in #983
• ENG 2332 Differentiate warning between pending and upstream failure by @eunice-chan in #986
• ENG-2457: Fixes DAG flashing on workflow details page by @agiron123 in #991
• ENG 2271 GC workflow notification settings when deleting an notification by @likawind in #963
• [1/2] Allow for previewing an operator with custom parameters by @kenxu95 in #988
• Log performance breakdown when running Python operators by @cw75 in #981
• Fix bug where we don't allow user switch engine back to Aqueduct by @kenxu95 in #990
• Parallelize CreateLambdaFunction() via ErrGroup by @Fanjia-Yan in #740
• 0.2.1 --> 0.2.2 Release by @kenxu95 in #1001