Skip to content

1.4

Compare
Choose a tag to compare
@pankajastro pankajastro released this 12 Jan 11:07
· 23 commits to release-1.4 since this release

Feature:

  • Support SFTP as file location docs #1481
  • Support FTP as file location docs #1482
  • Add support for Azure Blob Storage (only non-native implementation) #1275, #1542
  • Add databricks delta table support docs #1352, #1397, #1452, #1476, #1480, #1555
  • Add sourceCode facet to aql.dataframe() and aql.transform() as part of OpenLineage integration #1537
  • Enhance LoadFileOperator so that users can send pandas attributes through PandasLoadOptions docs #1466
  • Enhance LoadFileOperator so that users can send Snowflake specific load attributes through SnowflakeLoadOptions docs #1516
  • Expose get_file_list_func to users so that it returns iterable File list from given destination file storage #1380

Improvements

  • Deprecate export_table_to_file in favor of export_to_file (ExportTableToFileOperator and export_table_to_file operator would be removed in astro-python-sdk 1.5.0) #1503

Bug fixes

  • LoadFileOperator operator checks for conn_type and conn_id provided to File #1471
  • Generate constraints on releases and pushes (not PRs) #1472

Docs

  • Change export_file to export_table_to_file in the documentation #1477
  • Enhance documentation to describe the new Xcom requirements from Astro SDK 1.3.3 and airflow 2.5 #1483
  • Add documentation around LoadOptions with example DAGs #1567

Misc

  • Refactor snowflake merge function for easier maintenance #1493