Skip to content

1.6.0

Compare
Choose a tag to compare
@tatiana tatiana released this 03 May 20:35

Feature

  • Add MySQL support #1801
  • Add support to load from Azure blob storage into Databricks #1561
  • Add argument skip_on_failure to CleanupOperator #1837 by @scottleechua
  • Add query_modifier to raw_sql, transform and transform_file, which allow users to define SQL statements to be run before the main query statement #1898.
    Example of how to use this feature can be used to add Snowflake query tags to a SQL statement:
    from astro.query_modifier import QueryModifier
    @aql.run_raw_sql(
        results_format="pandas_dataframe",
        conn_id="sqlite_default",
        query_modifier=QueryModifier(pre_queries=["ALTER team_1", "ALTER team_2"]),
    )
    def dummy_method():
        return "SELECT 1+1"
  • Upgrade astro-runtime to 7.4.2 #1878

Bug fix

  • Raise exception in case larger dataframes than expected are passed to aql.dataframe #1839
  • Revert breaking change introduced in 1.5.0, re-allowing aql.transform to receive `sql filepath #1879

Docs

  • Update open lineage documentation #1881

Misc

  • Support Apache Airflow 2.6 #1899, with internal serialization changes
  • Add basic tiltifle for local dev #1819