Release 1.9.0

[pankajkoti]

Breaking changes

• When using LoadMode.DBT_LS, Cosmos will now attempt to use the dbtRunner as opposed to subprocess to run dbt ls.
  While this represents significant performance improvements (half the vCPU usage and some memory consumption improvement), this may not work in
  scenarios where users had multiple Python virtual environments to manage different versions of dbt and its adaptors. In those cases,
  please, set RenderConfig(invocation_mode=InvocationMode.SUBPROCESS) to have the same behaviour Cosmos had in previous versions.
  Additional information here <https://astronomer.github.io/astronomer-cosmos/configuration/parsing-methods.html#dbt-ls>_ and here <https://astronomer.github.io/astronomer-cosmos/configuration/render-config.html#how-to-run-dbt-ls-invocation-mode>_.

Features

• Use dbtRunner in the DAG Processor when using LoadMode.DBT_LS if dbt-core is available by @tatiana in Use dbtRunner in the DAG Processor when using LoadMode.DBT_LS if dbt-core is available #1484. Additional information here <https://astronomer.github.io/astronomer-cosmos/configuration/parsing-methods.html#dbt-ls>_.
• Allow users to opt-out of dbtRunner during DAG parsing with InvocationMode.SUBPROCESS by @tatiana in Allow users to opt-out dbtRunner during DAG parsing #1495. Check out the documentation <https://astronomer.github.io/astronomer-cosmos/configuration/render-config.html#how-to-run-dbt-ls-invocation-mode>_.
• Add structure to support multiple db for async operator execution by @pankajastro in Add structure to support multiple db for async operator execution #1483
• Support overriding the profile_config per dbt node or folder using config by @tatiana in Support overriding the profile_config per dbt node or folder using config #1492. More information here <https://astronomer.github.io/astronomer-cosmos/profiles/#profile-customise-per-node>_.
• Create and run accurate SQL statements when using ExecutionMode.AIRFLOW_ASYNC by @pankajkoti, @tatiana and @pankajastro in Create and run accurate SQL statements when using ExecutionMode.AIRFLOW_ASYNC #1474
• Add AWS ECS task run execution mode by @CarlosGitto and @aoelvp94 in Add AWS ECS task run execution mode #1507
• Add support for running DbtSourceOperator individually by @victormacaubas in Add Support for Running DbtSourceOperator Individually #1510
• Add setup task for async executions by @pankajastro in Add setup task for async executions #1518
• Add teardown task for async executions by @pankajastro in Add teardown task #1529

Bug Fixes

• Fix select complex intersection of three tag-based graph selectors by @tatiana in Fix custom "+tag:some_tag" selector issue related to tests tag inheritance #1466
• Fix custom selector behaviour when the model name contains periods by @yakovlevvs and @60098727 in Fix custom selector behaviour when the model name contains periods #1499
• Filter dbt and non-dbt kwargs correctly for async operator by @pankajastro in Filter dbt and non-dbt kwrgs correctly for async operator #1526

Enhancement

• Fix OpenLineage deprecation warning by @CorsettiS in Fix OpenLineage deprecation warning #1449
• Move DbtRunner related functions into dbt/runner.py module by @tatiana in Move DbtRunner related functions into dbt/runner.py module #1480
• Add on_warning_callback to DbtSourceKubernetesOperator and refactor previous operators by @LuigiCerone in Add on_warning_callback to DbtSourceKubernetesOperator and refactor previous operators #1501
• Gracefully error when users set incompatible RenderConfig.dbt_deps and operator_args install_deps by @tatiana in Gracefully error when users set imcompatible RenderConfig.dbt_deps and operator_args install_deps #1505
• Store compiled SQL as template field for ExecutionMode.AIRFLOW_ASYNC by @pankajkoti in Store compiled SQL as template field for ExecutionMode.AIRFLOW_ASYNC #1534

Docs

• Improve RenderConfig arguments documentation by @tatiana in Improve RenderConfig arguments documentation #1514
• Improve callback documentation by @tatiana in Improve callback documentation #1516
• Improve partial parsing docs by @tatiana in Improve partial parsing docs #1520
• Fix typo in selecting & excluding docs by @pankajastro in Fix typo in selecting & excluding docs #1523

Others

• Ignore dbt package tests when running Cosmos tests by @tatiana in Ignore dbt package tests when running Cosmos tests #1502
• Refactor to consolidate async dbt adapter code by @pankajkoti in Refactor to consolidate async dbt adapter code #1509
• Log elapsed time for sql file(s) upload/download by @pankajastro in Log elapsed_time for sql file upload/download #1536
• Remove the fallback operator for async task by @pankajastro in Remove the fallback operator for async task #1538
• GitHub Actions Dependabot: Bump pypa/gh-action-pypi-publish from 1.12.3 to 1.12.4 #1487
• Pre-commit updates: ⬆ [pre-commit.ci] pre-commit autoupdate #1473, ⬆ [pre-commit.ci] pre-commit autoupdate #1493, ⬆ [pre-commit.ci] pre-commit autoupdate #1503, ⬆ [pre-commit.ci] pre-commit autoupdate #1531

[cloudflare-workers-and-pages]

Deploying astronomer-cosmos with    Cloudflare Pages

Latest commit:	f38876c
Status:	✅  Deploy successful!
Preview URL:	https://e4985765.astronomer-cosmos.pages.dev
Branch Preview URL:	https://release-1-9-0.astronomer-cosmos.pages.dev

View logs

[netlify]

✅ Deploy Preview for sunny-pastelito-5ecb04 canceled.

Name	Link
🔨 Latest commit	f38876c
🔍 Latest deploy log	https://app.netlify.com/sites/sunny-pastelito-5ecb04/deploys/67af0d1b706b00000864b5fa

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 97.30%. Comparing base (968b80e) to head (f38876c).

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #1539   +/-   ##
=======================================
  Coverage   97.30%   97.30%           
=======================================
  Files          80       80           
  Lines        4854     4854           
=======================================
  Hits         4723     4723           
  Misses        131      131           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.