v0.2.8

Released on March 29, 2023.

Enhancements

• Extends Aqueduct's parameter support to allow parameters to be None if
  there is a default value for the parameter in the function definition.
• Tweaks the design of the workflow details page to reduce the number of shades
  of blue.
• Updates SQL query parametrization scheme to use $1, $2, etc. as parameter
  placeholders rather than the previous { param } syntax. This allows a
  paramter to be reused multiple times within the same query and is similar
  to how traditional RDBMS interfaces work.
• Adds context about the execution configuration of an operator to the workflow
  details page. Now, each operator will show the logo of the engine on which
  its running.

Bugfixes

• Fixes bug where the metric history graph's X-axis would not reflect
  timescales; all data points would be evenly spaced out rather than
  reflecting the amount of time between each point.
• Fixes bug where cross-environment Python requirements gathering would lead to
  erroneous installation. Currently, Aqueduct only supports explicit
  requirements specification.
• Fixes bug where certain workflow failures would leave unfinished operators in
  an infinitely-pending state; now, nodes are correctly marked as canceled.
• Fixes bug where retrieving a non-existent filepath from S3 would return
  succesfully but with empty data; now, a detailed error message is shown
  instead.
• Fixes bug where attempting to capture a system metric would thrown an error.

All Changes

v0.2.7...v0.2.8

All commits

• Changelog typo fix by @cw75 in #1131
• Fix ondemand k8s doc link by @cw75 in #1132
• Set up demo codespace by @likawind in #1122
• ENG-2622 Show metrics history graph temporally on the x axis. by @agiron123 in #1133
• Remove gathering requirements from user environment by @jpurusho65 in #1123
• Eng 2441 Update node statuses to cancel when workflow run is finished by @eunice-chan in #1129
• ENG-2537 Adds DAG Layout Test Cases by @agiron123 in #1128
• Add an empty requirements.txt files by @jpurusho65 in #1140
• Create implicit parameters with the default value being what's specified in the function signature by @cw75 in #1141
• [ENG-2687] Reduce the number of shades of blue on workflow details page by @vsreekanti in #1142
• Fix sql query parameterization bug using $1, $2 placeholders by @kenxu95 in #1134
• [ENG-2676] Show operator context on nodes by @vsreekanti in #1121
• Adds support for bigquery integration tests by @saurav-c in #1136
• Fix bug where using S3 integration with non-existent filepath succeeds by @Fanjia-Yan in #1070
• Add system_metric function to GenericArtifact by @hsubbaraj-spiral in #1138
• Fix bug with ExecuteWorkflow and DatabricksJobs by @hsubbaraj-spiral in #1143
• Reframe README to match latest positioning by @vsreekanti in #1114
• Release 0.2.8 by @eunice-chan in #1147

v0.2.7

Released on March 22, 2023.

Key Features

• [Beta] Aqueduct now has support for on-demand Kubernetes cluster creation and management on AWS. From the Aqueduct UI, you can connect Aqueduct to your AWS account via the cloud integration feature. Once connected, you can use this cloud integration to ask Aqueduct to automatically create a Kubernetes cluster for you. See the documentation here for how to create an operator that uses on-demand Kubernetes.

Enhancements

• Improves error handling to return more detailed error messages from errors occurring during execution.
• Improves error handling by surfacing errors that occur outside of the execution of an individual function as workflow-level errors; these errors could occur for example if a compute system was misconfigured.
• Improves handling of artifact name conflicts in the Python SDK. Explicitly named artifacts (using either the outputs argument to the @op decorator or the .set_name() function) will immediately flag and prevent conflicts in artifact names. Automatically named artifacts will error if multiple artifacts with the same name are included in a single publish_flow call.
• Displays all compute engines associated with a workflow on the workflows list page.
• Improves efficiency when previewing large objects on the UI by retrieving a sample of the data instead of the full data object and noting that the displayed data is a sample.

Bugfixes

• Fixes bug where an S3 or GCS bucket being used as the Aqueduct artifact store could possibly be deleted from the UI.
• Fixes bug that caused navigation buttons to be misaligned with other buttons on the action bar on the workflow details page.
• Fixes bug where navigating to the next most recent run on the workflow details page would not work correctly.
• Fixes bug pending or errored metric would show as "Unknown" on the UI instead of with the correct status.
• Fixes bug where warning-level checks were being shown as failures on the workflows list page.
• Fixes bug where certain DAG layouts would continue to show a layout with overlapping and crossing edges.

Note

• The parameterization of SQL queries may have unexpected behavior if you accidentally define a
  parameter with the same name twice. The parameter value will be chosen at random in such a case.
  This bug will be fixed in the next release.

All Changes

v0.2.6...v0.2.7

All commits

• ENG 2487: Fix bug where user is allowed to delete an integration that is being used as the storage layer by @eunice-chan in #1086
• Update README.md by @vsreekanti in #1096
• Deprecate FlowConfig in SDK by @jpurusho65 in #1094
• [ENG-2631] Fixes bug that caused navigation buttons to be misaligned by @vsreekanti in #1099
• Change error surfacing to also return inner error messages by @cw75 in #1102
• [ENG-2652] Remove dead code from UI by @vsreekanti in #1104
• Use context.Background() for deferred functions by @hsubbaraj-spiral in #1101
• Add a workflow-level error banner on the UI for errors that occur outside the workflow's context by @kenxu95 in #1107
• Allow creating multiple AWS integrations by @cw75 in #1092
• ENG-2339 Empty String Parameter Rendering Fix by @agiron123 in #1115
• Fix bug where AWS region is hardcoded when configuring kube config and terraform by @cw75 in #1111
• [ENG-2645] Fixes bug where next run button was broken on the UI by @vsreekanti in #1118
• Update the naming scheme for artifacts in our SDK by @kenxu95 in #1093
• ENG 2458 give all history rows a timestamp by @eunice-chan in #1100
• Add automated periodic integration test coverage for SQLite by @kenxu95 in #1119
• Upload the tfstate file at the end of periodic tests by @kenxu95 in #1109
• ENG-2577 Fix bug where warning state is not properly reflected on metadata list views by @agiron123 in #1117
• Fix bug where all errors were surfaced as workflow-level errors by @kenxu95 in #1116
• ENG-2620 DAG Line Crossing Fix by @agiron123 in #1113
• Fix a bug where engine icon is not properly shown in list workflow page by @likawind in #1110
• Improve UI efficiency on previewing large data by @likawind in #1103
• Minor updates to dynamic integration docstring and error message by @cw75 in #1120
• [ENG-2656, WIP] Adds workflow history route, store by @vsreekanti in #1108
• Upload more state and retry when terraform destroy fails by @kenxu95 in #1124
• ENG-2577 follow up by @agiron123 in #1125
• Update automated terraform destroy by @kenxu95 in #1127
• Release 0.2.7 by @cw75 in #1126

New Contributors

• @jpurusho65 made their first contribution in #1094

v0.2.6

0.2.6

Released on March 14, 2023.

All Changes

v0.2.5...v0.2.6

Key Features

• Enables registering a workflow without immediately triggering a run of that workflow. When calling publish_flow the run_now parameter can be set to False, which will tell the Aqueduct server to wait until the next scheduled (or triggered) run. In the interim, only the DAG's structure will be shown without any execution metadata.

Enhancements

• Adds error checking to ensure that a remote compute engine is paired with a remote artifact store.
• Adds error checking to ensure that a valid kubeconfig is provided when connecting Aqueduct to Kubernetes.
• Enables using ~ to refer to the home directory when specifying a path to AWS credentials or a kubeconfig.
• Adds icons to integration details views to indicate when an object store (AWS S3, GCS) are being used for metadata storage.
• Allows specifying the specific library version of CUDA when requesting GPU resources; v11.4.1 is the current default because that is what EKS clusters use by default.

Bugfixes

• Fixes bug where certain errors occurring during task launch weren't clearly surfaced in the Aqueduct stack.
• Fixes bug where, within a Python process, executing an operator in lazy mode precluded users from later executing it in eager mode (or vice versa).
• Fixes bug where notification count wasn't being shown.
• Fixes bug where the notice for an ongoing metadata migration would run off the end of the screen.
• Removes duplicate "History" header on metric details page.

All commits

• Fixes broken pre-merge tests by @kenxu95 in #1037
• Allows for Snowflake VARCHAR to be of the max size by @saurav-c in #1038
• Fix requirements issues on fresh aqueduct install by @likawind in #1032
• Implement the basic SDK and backend support for dynamic k8s integration by @cw75 in #1033
• Add UI support for connecting AWS integration by @cw75 in #1036
• Allows users to optionally specify snowflake role by @saurav-c in #1035
• Make dynamic k8s cluster resilient against server failures and race conditions by @cw75 in #1040
• [ENG-2273] Updates layout of workflow header by @vsreekanti in #1045
• Disable AWS integration registration from UI and SDK by @cw75 in #1053
• [1/5] Decouple exec env data model creation and conda env creation by @likawind in #1011
• ENG 2494 Fix a bug where metric graph dates are cutted off by @likawind in #1048
• Enable 'list operators on integration' for compute integrations by @likawind in #1044
• [ENG-2563] Remove dead & refactor confusing UI code by @vsreekanti in #1054
• ENG 2439 add engine and resource to metrics and checks by @likawind in #1049
• Fix mypy failure in GH actions by @likawind in #1059
• [ENG-2573] Updates DAG node design by @vsreekanti in #1057
• [1/2] Eng-2503: Refactor Conda Connection Status for more generic purposes by @Fanjia-Yan in #1041
• [2/2]Eng 2503: Connecting to Lambda Asynchronously by @Fanjia-Yan in #1042
• ENG-2170 Settings Update Toast and Navigation Updates by @agiron123 in #1058
• 0.2.5 Release by @saurav-c in #1062
• Add K8s integration tests to our periodic integration tests by @kenxu95 in #1046
• Do not require an explicit apikey field in test-credentials.yml by @kenxu95 in #1068
• Upgrade reactflow v10->v11, @reduxjs/toolkit by @eunice-chan in #1013
• Delete dynamic k8s cluster only when no pods are running by @cw75 in #1051
• Have our GH actions slack integration always tag the appropriate oncall by @kenxu95 in #1064
• Fix bug where compute integration can be registered without configuring cloud storage by @cw75 in #1066
• Fix bug where error occurred during job manager launch is not caught as operator error by @cw75 in #1065
• Adds backend support for changing storage layer back to local by @saurav-c in #1055
• Fix a test case that's expected to run only when using sqlite as data integration by @cw75 in #1074
• Check K8s config is valid during k8s integration validation by @cw75 in #1067
• Fix bug where calling an operator fixes it's execution mode by @cw75 in #1072
• Refactors storage error to include stack trace by @saurav-c in #1076
• Refactors lib/database to follow new errors convention by @saurav-c in #1081
• Fixes airflow workflow registration bugs by @saurav-c in #1082
• Get our credentials paths working with ~ by @cw75 in #1073
• ENG-2430: SX prop not picking up colors from theme by @agiron123 in #1075
• Make EKS cluster parameters configurable by @cw75 in #1052
• Allow registering AWS integration with custom config from the UI by @cw75 in #1061
• ENG-2610: Fix crash on workflow details page by @agiron123 in #1087
• ENG-1966 no indication on s3 integration details by @agiron123 in #1009
• [1/2] Allow user to register workflow without triggering by @likawind in #1043
• ENG 2410 improve metadata migration notice looking by @likawind in #1079
• ENG-2514 handle multipe engines in a workflow by @likawind in #1080
• Remove unnecessary history header by @hsubbaraj-spiral in #1084
• Fix bug with DatabricksJob preview by @hsubbaraj-spiral in #1083
• Added notebook for Spark Demo by @hsubbaraj-spiral in #1085
• Adds option for users to specify CUDA version by @hsubbaraj-spiral in #1071
• Updates gpu names in Makefile by @hsubbaraj-spiral in #1088
• Updates default workflow timeout to 48 hours by @agiron123 in #1089
• Release v0.2.6 by @agiron123 in #1090

v0.2.5

Released on March 7, 2023.

Key Features

• Users can now run Aqueduct workflows on Spark clusters on AWS EMR. With Apache Livy as an interface, Aqueduct can submit your code to your Spark cluster reliably and seamlessly. See our documentation here.
• Redesigns node layout on DAG view to improve information presentation and better distinguish between different node types.

Enhancements

• Enables specification of Snowflake role when connecting the Snowflake integration.
• Updates workflow details page header to be more compact and reduce information overload.
• Adds support for specifying compute engine and resource requirements when creating metrics & checks.

Bugfixes

• Fixes issue where size of large rows on Snowflake was artificially limited.
• Resolves requirement mismatches that would occur on the latest versions of Ubuntu 22.
• Fixes layout issue where dates on metric history graph could have been cut off.
• Fixes bug where the integration details page for compute integrations would not list all workflows using that integration.
• Fixes bug where metrics plot failed to render when upstream operator was cancelled.

All Changes

v0.2.4...v0.2.5

All commits

• Fixes broken pre-merge tests by @kenxu95 in #1037
• Allows for Snowflake VARCHAR to be of the max size by @saurav-c in #1038
• Fix requirements issues on fresh aqueduct install by @likawind in #1032
• Implement the basic SDK and backend support for dynamic k8s integration by @cw75 in #1033
• Add UI support for connecting AWS integration by @cw75 in #1036
• Allows users to optionally specify snowflake role by @saurav-c in #1035
• Make dynamic k8s cluster resilient against server failures and race conditions by @cw75 in #1040
• [ENG-2273] Updates layout of workflow header by @vsreekanti in #1045
• Disable AWS integration registration from UI and SDK by @cw75 in #1053
• [1/5] Decouple exec env data model creation and conda env creation by @likawind in #1011
• ENG 2494 Fix a bug where metric graph dates are cutted off by @likawind in #1048
• Enable 'list operators on integration' for compute integrations by @likawind in #1044
• [ENG-2563] Remove dead & refactor confusing UI code by @vsreekanti in #1054
• ENG 2439 add engine and resource to metrics and checks by @likawind in #1049
• Fix mypy failure in GH actions by @likawind in #1059
• [ENG-2573] Updates DAG node design by @vsreekanti in #1057

v0.2.4

Release on Mar 1, 2023.

Enhancements

• Opens links to docs and feedback in new tabs rather than in the existing tab on the Aqueduct UI.
• When authoring a pipeline, allows reusing the same Python function multiple times in the same DAG.
• Improves the layout of the card displaying metadata storage information on the settings page.

Bugfixes

• Fixes bug where changing the Aqueduct metadata storage layer when there was a previously-failed workflow would cause the data migration process to pause.
• Fixes bug where certain DAGs would render in a confusing fashion on the workflow details page. The algorithm for DAG layouts is now significantly more reliable.

All Changes

v0.2.3...v0.2.4

All commits

• ENG 2499 open docs and feedback links in new tab by @eunice-chan in
  #1020
• Use Spark integration on SDK by @hsubbaraj-spiral in
  #993
• Adding Spark integration to UI by @hsubbaraj-spiral in
  #994
• [1/2] Add golang apache livy client by @hsubbaraj-spiral in #995
• Pull test-config.yml from S3 for pre-merge integration tests by @kenxu95 in #1024
• Complete our pre-merge test suite by @kenxu95 in #1028
• Copies migrator binary instead of moving it by @saurav-c in #1031
• Fixes bug in the storage migration process with migrating failed artifact results by @saurav-c in #1030
• Allows users to reuse operator in a workflow by @saurav-c in #1027
• Eng 2506 storage metadata design feedback by @agiron123 in #1021
• Eng 2450 fix node layout algo by @agiron123 in #1029
• 0.2.4 release by @likawind in #1034

v0.2.3

Released on February 22, 2023.

Enhancements

• Updates workflow and data table views to show overview of all executed checks rather than just one.
• Garbages collect Lambda-specific Docker images from the Aqueduct server's machine after the Lambda integration connection is finished.
• Improves performance of the Aqueduct serialization library by looking into collection types (lists, tuples) and using data-type specific serialization methods for each entry.
• On the Aqueduct settings page, adds details about what storage engine is being used for metadata and version snapshot storage.

Bugfixes

• Fixes detail header alignment on artifact and operator details pages.
• Fixes bug where latest MariaDB and MySQL drivers were not being installed correctly on M1 Macs.
• Fixes bug where running the same function with multiple unnamed parameters more than once would fail.
• Fixes bug where Aqueduct Docker images running for save operators were missing dependencies for certain data types.

All Changes

v0.2.2...v0.2.3

All commits

• Change nvidia/cuda base image to 11.4.1 by @hsubbaraj-spiral in #1002
• Refactors lib/collections by replacing it with lib/models by @saurav-c in #997
• ENG-2475: Bug: Better align operator and artifact 'outputs' and 'generated by' headers by @agiron123 in #999
• ENG 2400 Fix aqueduct install mariadb for Mac M1 by @eunice-chan in #1000
• ENG-2369 Checks List Overview in Check Metadata Table Cell by @agiron123 in #998
• Fix bug where rerunning a function with multiple implicit parameters fails by @kenxu95 in #1004
• Removes deprecated save API from README by @vsreekanti in #1006
• Support notifications in manual QA testing script by @likawind in #1005
• Eng 2377 Delete local lambda images after connecting to lambda by @Fanjia-Yan in #987
• Fix notifications doc link in UI by @likawind in #1010
• ENG-2084 Add details to settings page about what storage is being used for metadata by @agiron123 in #1008
• Adds tensorflow to s3 images by @hsubbaraj-spiral in #1012
• Improve the serialization performance of pickled lists and tuples by @kenxu95 in #1007
• Fix bug when serializing a list of tables to S3 by @kenxu95 in #1014
• Creates 0.2.3 Release by @hsubbaraj-spiral in #1015
• Updates manual qa test checklist by @hsubbaraj-spiral in #1017
• ENG-2508: Safari Bug Fixes by @agiron123 in #1016

v0.2.2

Key Features

• Adds support for receiving Aqueduct notifications via email or in Slack
  workspaces. You can configure notification settings for your Aqueduct
  installation at large, and you can also customize notification settings
  per-workflow. Notifications can be configured to be sent for all workflow
  executions, only on warnings, or only on errors.
  • Email: You can connect Aqueduct to your email account and specify a
    list of email addresses as recipients. Each notification will trigger a
    separate email.
  • Slack: You can connect Aqueduct to your Slack workspace and specify a
    channel that Aqueduct should send notifications on. Each notification
    will send a separate message.

Enhancements

• Adds support for specifying Snowflake schema when creating integration from
  UI.
• Adds support for executing an operator that has one or more parameters and
  multiple outputs interactively. You can call the same function, and
  Aqueduct will automatically override previous implicitly created
  parameters. See our
  documentation for more details.

  @op
  def fn(param):
    return param
  
  res = fn(1).get()
  >>> 1 # Creates a parameter named `param` for you automatically, with a default value of 1.
  
  res = fn(2).get()
  >>> 2 # Updates `param` to have a default value of 2.

Bugfixes

• Fixes two bugs where Aqueduct server was retrieving full data objects from
  the Aqueduct metadata store to check for their existence. When working
  with non-trivial data, this could cause serious performance issues.
• Fixes bug where object does not exist errors from S3 were mishandled, causing
  Aqueduct to surface incorrect errors.
• Fixes bug where pods that are marked as pending on Kubernetes were being
  treated as failed operators.
• Fixes bug where log and stack traces blocks didn't have proper formatting and
  backgrounds on the UI.
• Fixes bug that was causing full data objects to be retrieved repeatedly when
  loading metadata on the UI.
• Fixes bug where UI was previously treating not-yet-executed operators (for an
  in-progress workflow) as failed operators.
• Fixes bug where the SDK's global_config could not be changed to set
  Aqueduct as the compute engine.

All Changes

v0.2.1...v0.2.2

All commits

• ENG-2171 Add Tabs to Workflow Details Page by @agiron123 in #962
• Fix performance issue when using S3 as metadata storage by @cw75 in #973
• Allows user to specify optional Snowflake schema in UI by @saurav-c in #972
• Adds a storage.exists() check to replace extra storage.get() by @hsubbaraj-spiral in #974
• ENG-2285 MySQL Integration Testing Setup by @agiron123 in #960
• ENG-2286 Postgres Integration Test Setup by @agiron123 in #956
• Fix bug in S3 GET error handling and k8s pod status handling by @cw75 in #976
• ENG 2405 Fix bug where log and stack traces divs don't have backgrounds by @eunice-chan in #967
• Fix bug where we are retrieving artifact payloads on workflow page by @cw75 in #978
• Eng 2362 Fix IP address display for common cloud providers by @eunice-chan in #979
• Eng 2284 Integrate MariaDB to Integration Tests by @eunice-chan in #968
• ENG-2453 Dag Width and Height Fixes by @agiron123 in #980
• Pass in jobManager to Operators if shared context is required by @hsubbaraj-spiral in #969
• ENG-2409 TabPanel Component by @agiron123 in #983
• ENG 2332 Differentiate warning between pending and upstream failure by @eunice-chan in #986
• ENG-2457: Fixes DAG flashing on workflow details page by @agiron123 in #991
• ENG 2271 GC workflow notification settings when deleting an notification by @likawind in #963
• [1/2] Allow for previewing an operator with custom parameters by @kenxu95 in #988
• Log performance breakdown when running Python operators by @cw75 in #981
• Fix bug where we don't allow user switch engine back to Aqueduct by @kenxu95 in #990
• Parallelize CreateLambdaFunction() via ErrGroup by @Fanjia-Yan in #740
• 0.2.1 --> 0.2.2 Release by @kenxu95 in #1001

v0.2.1

Key Features

• Allows customizing artifact names from the SDK in one of two ways.

  # Method 1: Use the decorator
  @op(outputs=['sklearn model', 'churn predictions'])
  def train_and_predict_churn(features):
    # ...
    return model, predictions
  # Method 2: Use .set_name()
  @op
  def train_model(features):
    # ...
    return model
  # ...
  model = train_model(features)
  model.set_name('churn model')

Enhancements

• Allows providing filepath to ServiceAccount key file when connecting to BigQuery from Aqueduct SDK.
• Improves form validation when connecting Databricks integration.
• Throughout the SDK, enables references to workflows using workflow name in addition to workflow ID.
• Puts upper bounds on Python package dependencies to prevent unexpected regressions (e.g., recent issues caused by SQLAlchemy 2.0).

Bugfixes

• Fixes bug where errors were not being properly handled when an operator had multiple outputs. This was occurring because the return value didn't have the expected length.

All Changes

v0.2.0...v0.2.1

All commits

• ENG-2303 by @agiron123 in #937
• [1/2] Split test-config.yml into credentials and run config files by @kenxu95 in #940
• Deletes accidentally committed config file by @saurav-c in #950
• Fix broken periodic integration tests by @kenxu95 in #954
• Allows user to provide filepath to BigQuery credentials when connecting via SDK by @saurav-c in #947
• Adds support for running bigquery data integration testing by @saurav-c in #948
• ENG-2373 Improve Databricks Add Integration Form Validation by @agiron123 in #946
• Fix the skip integration test label by @kenxu95 in #959
• Eng 2195 Implement application logic to send notifications by @likawind in #926
• Allows users to customize artifact names by @kenxu95 in #953
• ENG 2288 Integrate SQLite to Integration Tests by @eunice-chan in #942
• Compete Athena integration test by @cw75 in #957
• Fixes bug in handling user error with mismatch in output count by @saurav-c in #951
• Allows use of flow name instead of id in SDK by @saurav-c in #961
• Adds Python pkg version upper bounds by @saurav-c in #949
• Eng 2289 complete mongodb integration testing by @likawind in #955
• ENG-2406 Fix for metrics not showing properly on the data page. by @agiron123 in #965
• 0.2.0 --> 0.2.1 Release by @eunice-chan in #966

v0.2.0

Released on January 31, 2023

Key Features

• [Beta] Aqueduct now supports running workflows on Databricks Spark clusters!
  As of this release, you can now connect Aqueduct to a Databricks cluster
  from the UI and use the Aqueduct decorator API to deploy workflows onto
  those clusters.
  • Databricks workflows can read data from Snowflake and AWS S3. Future
    releases support other data systems, including Delta Lake.
  • Currently, you cannot run a subset of a workflow on a Databricks cluster;
    the whole workflow must be run on Databricks.
  • We plan to add support for non-Databricks Spark clusters in the coming
    releases.

Enhancements

• Allows workflows running on Airflow to be triggered upon the completion of
  other workflows. Note that the completion of an Airflow workflow cannot
  trigger the execution of another workflow because completion state is not
  synchronously tracked on Airflow.
• Unifies color and size of status indicators throughout the UI.

Bugfixes

• Fixes bug where internal server error was uncaught when retrieving operator
  results.
• Fixes bug where workflow status bar had unnecessary backticks around objects.
• Fixes bug where access checks for AWS S3 buckets would fail with certain
  permissions that were in fact valid.
• Fixes bug where saving tables to relational databases with long column names
  (> 255 characters) would fail.
• Fixes bug where SQLAlchemy version 2 introduced access issues with Pandas
  DataFrames. Our current solution is to require SQLAlchemy version 1.
• Fixes bug where listing tables in BigQuery required complex, brittle SQL
  queries.
• Fixes bug where data listing page might crash on UI after the execution of a
  failed workflow.
• Fixes bug where status indicator on check and metric details was not being
  properly displayed.
• Fixes bug where checks and metrics of failed workflow executions show no values.
• Fixes bug where after switching to cloud storage as the metadata store, new integration
  credentials weren't properly saved to cloud storage.
• Fixes bug where preview fails after switching to cloud storage as the metadata store.
• Fixes bug where failing metrics show as NaN in metric preview list on UI.

Deprecations

• The .save() on Artifacts has been removed. As of
  v0.1.6, the
  recommended method is to use the .save() API on integration objects.

All Changes

v0.1.11...v0.2.0

All commits

• Fix bug where get operator result go routine fails to check for error by @cw75 in #912
• ENG-2134 Remove Unnecessary Backticks in WorkflowStatusBar Warning list item by @agiron123 in #915
• Fix bug where get operator result go routine fails to check for error by @cw75 in #913
• Fix bug where S3 integration authentication step fails even when the user does have permission by @cw75 in #917
• Get K8s Compute Working with Aqueduct Integration Tests by @kenxu95 in #920
• Fixes bug where saving to relational DBs failed for large string cols by @saurav-c in #918
• [1/2][Backend] Eng 2193 add email integration to backend by @likawind in #898
• Adds data integration tests for Redshift by @saurav-c in #919
• Fix bug where pandas versioning causes workflows to fail by @cw75 in #925
• ENG-2326, ENG-2335 Frontend Dev Mode Fixes by @agiron123 in #921
• Fix a bug where demo db upload is broken in GH actions by @likawind in #927
• Fix integration tests with sqlalchemy hack by @likawind in #928
• Eng 2196 Add notification settings to workflow table by @likawind in #922
• Eng 2122 unify use of color and size in status indicators by @eunice-chan in #908
• Fixes bug for listing big query tables by @saurav-c in #929
• Adds cascading updates support for workflows running on Airflow by @saurav-c in #930
• [1/2] Support Large Data on Databricks by @hsubbaraj-spiral in #896
• eng-2310 Add status in check + metric detail page header by @eunice-chan in #914
• ENG-2308 Metric Preview Fixes by @agiron123 in #931
• Set restriction on sdk for using Databricks Integration by @hsubbaraj-spiral in #932
• ENG-2264 Data List Page Loading Fixes by @agiron123 in #916
• Fix bug where integration credentials aren't properly migrated to the cloud by @cw75 in #933
• Remove deprecated artifact.save() by @kenxu95 in #924
• ENG-2309 UI bug fixes for better rendering metrics and checks that have no value by @agiron123 in #934
• Ready for release 0.2.0 by @saurav-c in #938

v0.1.11

Released on January 23, 2023

Enhancements

• Upgrades workflow layout rendering tool to use the elkjs library.
• Shows the name of the options on the UI's menu sidesheet to improve clarity.
• Removes the Aqueduct logo on the UI's home page to reduce redundancy.

Bugfixes

• Fixes bug where operator execution fails when running on Kubernetes. This was due to a time gap
  between launching a Kubernetes job and spinning up a pod, and our system wasn't accounting
  for this.
• Fixes bug where the workflow details page keeps re-rendering.
• Fixes bug where the Kubernetes logo doesn't show up on the UI.
• Fixes bug where the UI keeps hitting the notification route, which led to unnecessary overhead.
  This was caused by omitting an empty dependency array in one of our useEffect hooks.

All Changes

v0.1.10...v0.1.11

All commits

* Remove dangling node positions call from SDK by @kenxu95 in https://github.com//pull/893 * Add convenience integration test running script by @kenxu95 in https://github.com//pull/895 * Fix bug where the UI keeps hitting the notification route by @cw75 in https://github.com//pull/899 * [SDK] Add some convenience get helpers to our SDK Integration Class by @kenxu95 in https://github.com//pull/900 * Fix bug where K8s Logo does not show up by @kenxu95 in https://github.com//pull/902 * Show option names on the sidesheet and remove the Aqueduct logo on the Home page by @cw75 in https://github.com//pull/903 * ENG-2290: Fix bug where workflow details page renders over and over. by @agiron123 in https://github.com//pull/901 * ENG-1851 Use elkjs for positioning nodes and edges by @agiron123 in https://github.com//pull/894 * Delete external data during test teardown in SDK Integration Tests by @kenxu95 in https://github.com//pull/904 * Fix a bug where operator execution fails when running on k8s by @cw75 in https://github.com//pull/907 * Prepare for 0.1.11 Release by @agiron123 in https://github.com//pull/909