0.9.1

Bugfix:

• Table unable to have Airflow templated names #413 . Issue reported by @guohui-gao and fixed by @sunank200

0.9.0

Enhancements:

• Introduction of the user-facing Table, Metadata, and File classes

Breaking changes:

• The operator save_file became export_file.
• The tasks load_file, export_file (previously save_file) and run_raw_sql should be used with use Table, Metadata and File instances
• The decorators dataframe, run_raw_sql and transform should be used with Table and Metadata instances.
• Temporary removal of the operators aggregate_check, boolean_check, render, and stats_check.
• Removal of the class TempTable. It is possible to declare temporary tables using Table(temp=True). All the temporary table names are prefixed with _tmp_. If the user decides to name a Table, it is no longer temporary.
• The only mandatory property of a Table instance is conn_id. If the user gives no metadata to Table, the library will try to extract schema and other information from the connection object. If undefined and the database supports schema, the SDK defaults the schema to the value in AIRFLOW__ASTRO__SQL_SCHEMA.

Internals:

• Major refactor introducing Database, File, FileType and FileLocation concepts.

0.8.5

What's Changed

Bugfix

• Fix snowflake missing package by @tatiana in #405

Full Changelog: 0.8.4...0.8.5

0.8.5b1

What's Changed

Bug fix

• Fix snowflake missing package by @tatiana in #405

Full Changelog: 0.8.4...0.8.5b1

0.9.0b1

Enhancements:

• Introduction of the user-facing Table, Metadata, and File classes

Breaking changes:

• The operator save_file became export_file.
• The tasks load_file, export_file (previously save_file) and run_raw_sql should be used with use Table, Metadata and File instances
• The decorators dataframe, run_raw_sql and transform should be used with Table and Metadata instances.
• Temporary removal of the operators aggregate_check, boolean_check, render, and stats_check.
• Removal of the class TempTable. It is possible to declare temporary tables using Table(temp=True). All the temporary table names are prefixed with _tmp_. If the user decides to name a Table, it is no longer temporary.
• The only mandatory property of a Table instance is conn_id. If the user gives no metadata to Table, the library will try to extract schema and other information from the connection object. If undefined and the database supports schema, the SDK defaults the schema to the value in AIRFLOW__ASTRO__SQL_SCHEMA.

Internals:

• Major refactor introducing Database, File, FileType and FileLocation concepts.

0.8.4

Enhancements:

• Add support for Airflow 2.3 #329.

Full Changelog: 0.8.3...0.8.4

0.8.3

Bug fix:

• Do not attempt to create a schema if it already exists #329. Issue reported by @jlaneve

0.8.2

Bug fix:

• Support dataframes from different databases in dataframe operator #325

Enhancements:

• Add integration testcase for SqlDecoratedOperator to test execution of Raw SQL #316

0.8.1

Bug fix:

• Snowflake transform without input_table #319

0.8.0

Feature:

• load_file support for nested NDJSON files #257

Breaking change:

• aql.dataframe switches the capitalization to lowercase by default. This behaviour can be changed by using identifiers_as_lower #154

Documentation:

• Fix commands in README.md #242
• Add scripts to auto-generate Sphinx documentation

Enhancements:

• Improve type hints coverage
• Improve Amazon S3 example DAG, so it does not rely on pre-populated data #293
• Add example DAG to load/export from BigQuery #265
• Fix usages of mutable default args #267
• Enable DeepSource validation #299
• Improve code quality and coverage

Bug fixes:

• Support gcpbigquery connections #294
• Support params argument in aql.render to override SQL Jinja template values #254
• Fix aql.dataframe when table arg is absent #259

Others:

• Refactor integration tests, so they can run across all supported databases #229, #234, #235, #236, #206, #217