v0.2.1

Key Features

• Allows customizing artifact names from the SDK in one of two ways.

  # Method 1: Use the decorator
  @op(outputs=['sklearn model', 'churn predictions'])
  def train_and_predict_churn(features):
    # ...
    return model, predictions
  # Method 2: Use .set_name()
  @op
  def train_model(features):
    # ...
    return model
  # ...
  model = train_model(features)
  model.set_name('churn model')

Enhancements

• Allows providing filepath to ServiceAccount key file when connecting to BigQuery from Aqueduct SDK.
• Improves form validation when connecting Databricks integration.
• Throughout the SDK, enables references to workflows using workflow name in addition to workflow ID.
• Puts upper bounds on Python package dependencies to prevent unexpected regressions (e.g., recent issues caused by SQLAlchemy 2.0).

Bugfixes

• Fixes bug where errors were not being properly handled when an operator had multiple outputs. This was occurring because the return value didn't have the expected length.

All Changes

v0.2.0...v0.2.1

All commits

• ENG-2303 by @agiron123 in #937
• [1/2] Split test-config.yml into credentials and run config files by @kenxu95 in #940
• Deletes accidentally committed config file by @saurav-c in #950
• Fix broken periodic integration tests by @kenxu95 in #954
• Allows user to provide filepath to BigQuery credentials when connecting via SDK by @saurav-c in #947
• Adds support for running bigquery data integration testing by @saurav-c in #948
• ENG-2373 Improve Databricks Add Integration Form Validation by @agiron123 in #946
• Fix the skip integration test label by @kenxu95 in #959
• Eng 2195 Implement application logic to send notifications by @likawind in #926
• Allows users to customize artifact names by @kenxu95 in #953
• ENG 2288 Integrate SQLite to Integration Tests by @eunice-chan in #942
• Compete Athena integration test by @cw75 in #957
• Fixes bug in handling user error with mismatch in output count by @saurav-c in #951
• Allows use of flow name instead of id in SDK by @saurav-c in #961
• Adds Python pkg version upper bounds by @saurav-c in #949
• Eng 2289 complete mongodb integration testing by @likawind in #955
• ENG-2406 Fix for metrics not showing properly on the data page. by @agiron123 in #965
• 0.2.0 --> 0.2.1 Release by @eunice-chan in #966