Releases: astronomer/astronomer-cosmos
Releases · astronomer/astronomer-cosmos
v1.5.0a4
New Features
- Support for running dbt tasks in AWS EKS in #944 by @VolkerSchiewe
- Support caching dbt ls output in Airflow variable in #1014 by @tatiana (WIP)
- different approach than 1.5.0a1 and 1.5.0a2
- fix log for TaskGroup
Others
- Improve error logging in
DbtLocalBaseOperator
in #1004 by @davidsteinar - Add GitHub issue templates for bug reports and feature request in #1009 by @pankajkoti
- Fix
dev/Dockerfile
+ Adduv pip install
for faster build time in #997 by @dwreeves - Drop support for Airflow 2.3 in #994 by @pankajkoti
- Update Astro Runtime image in #988 and #989 by @RNHTTR
- Enable ruff F linting in #985 by @pankajastro
- Move Cosmos Airflow configuration to settings.py in #975 by @pankajastro
- Fix CI Issues in #1005 by @tatiana
- Pre-commit hook updates in #1000
v1.5.0a3
New Features
- Support for running dbt tasks in AWS EKS in #944 by @VolkerSchiewe
- Support caching dbt ls output in Airflow variable in #1014 by @tatiana (WIP)
- different approach than 1.5.0a1 and 1.5.0a2
Others
- Improve error logging in
DbtLocalBaseOperator
in #1004 by @davidsteinar - Add GitHub issue templates for bug reports and feature request in #1009 by @pankajkoti
- Fix
dev/Dockerfile
+ Adduv pip install
for faster build time in #997 by @dwreeves - Drop support for Airflow 2.3 in #994 by @pankajkoti
- Update Astro Runtime image in #988 and #989 by @RNHTTR
- Enable ruff F linting in #985 by @pankajastro
- Move Cosmos Airflow configuration to settings.py in #975 by @pankajastro
- Fix CI Issues in #1005 by @tatiana
- Pre-commit hook updates in #1000
v1.5.0a2
1.5.0a2 (2024-05-23)
New Features
- Support for running dbt tasks in AWS EKS in #944 by @VolkerSchiewe
- Support caching at a DbtDag and DbtTaskGroupLevel in #992 by @tatiana (WIP)
- difference from 1.5.0a1: Include the timestamp of the DAG in the cache version
Others
- Drop support for Airflow 2.3 in #994 by @pankajkoti
- Update Astro Runtime image in #988 and #989 by @RNHTTR
- Enable ruff F linting in #985 by @pankajastro
- Move Cosmos Airflow configuration to settings.py in #975 by @pankajastro
v1.5.0a1
New Features
- Support for running dbt tasks in AWS EKS in #944 by @VolkerSchiewe
- Support caching at a DbtDag and DbtTaskGroupLevel in #992 by @tatiana (WIP)
Others
- Drop support for Airflow 2.3 in #994 by @pankajkoti
- Update Astro Runtime image in #988 and #989 by @RNHTTR
- Enable ruff F linting in #985 by @pankajastro
- Move Cosmos Airflow configuration to settings.py in #975 by @pankajastro
v1.4.1
Bug fixes
- Fix manifest testing behavior in #955 by @chris-okorodudu
- Handle ValueError when unpacking partial_parse.msgpack in #972 by @tatiana
Others
- Enable pre-commit run and fix type-check job by @pankajastro in #957
- Clean databricks credentials in test/CI in #969 by @tatiana
- Update CODEOWNERS in #969 by @tatiana
- Update emeritus contributors list in #961 by @tatiana
- Promote @dwreeves to committer in #960 by @tatiana
- Pre-commit hook updates in #956
v1.4.1rc1
Bug fixes
- Fix manifest testing behavior in #955 by @chris-okorodudu
- Handle ValueError when unpacking partial_parse.msgpack in #972 by @tatiana
Others
- Enable pre-commit run and fix type-check job by @pankajastro in #957
- Clean databricks credentials in test/CI in #969 by @tatiana
- Update CODEOWNERS in #969 by @tatiana
- Update emeritus contributors list in #961 by @tatiana
- Promote @dwreeves to committer in #960 by @tatiana
- Pre-commit hook updates in #956
v1.4.0
Features
- Add dbt docs natively in Airflow via plugin by @dwreeves in #737
- Add support for
InvocationMode.DBT_RUNNER
for local execution mode by @jbandoro in #850 - Support partial parsing to render DAGs faster when using
ExecutionMode.LOCAL
,ExecutionMode.VIRTUALENV
andLoadMode.DBT_LS
by @dwreeves in #800 - Improve performance by 22-35% or more by caching partial parse artefact by @tatiana in #904
- Add Azure Container Instance as Execution Mode by @danielvdende in #771
- Add dbt build operators by @dylanharper-qz in #795
- Add dbt profile config variables to mapped profile by @ykuc in #794
- Add more template fields to
DbtBaseOperator
by @dwreeves in #786 - Add
pip_install_options
argument to operators by @octiva in #808
Bug fixes
- Make
PostgresUserPasswordProfileMapping
schema argument optional by @FouziaTariq in #683 - Fix
folder_dir
not showing on logs forDbtDocsS3LocalOperator
by @PrimOox in #856 - Improve
dbt ls
parsing resilience to missing tags/config by @tatiana in #859 - Fix
operator_args
modified in place in Airflow converter by @jbandoro in #835 - Fix Docker and Kubernetes operators execute method resolution by @jbandoro in #849
- Fix
TrinoBaseProfileMapping
required parameter for non method authentication by @AlexandrKhabarov in #921 - Fix global flags for lists by @ms32035 in #863
- Fix
GoogleCloudServiceAccountDictProfileMapping
when getting values from the Airflow connectionextra__
keys by @glebkrapivin in #923 - Fix using the dag as a keyword argument as
specific_args_keys
in DbtTaskGroup by @tboutaour in #916 - Fix ACI integration (
DbtAzureContainerInstanceBaseOperator
) by @danielvdende in #872 - Fix setting dbt project dir to the tmp dir by @dwreeves in #873
- Fix dbt docs operator to not use
graph.gpickle
file when--no-write-json
is passed by @dwreeves in #883 - Make Pydantic a required dependency by @pankajkoti in #939
- Gracefully error if users try to
emit_datasets
withAirflow 2.9.0
or2.9.1
by @tatiana in #948 - Fix parsing tests that have no parents in #933 by @jlaneve
- Correct
root_path
in partial parse cache by @pankajkoti in #950
Docs
- Fix docs homepage link by @jlaneve in #860
- Fix docs
ExecutionConfig.dbt_project_path
by @jbandoro in #847 - Fix typo in MWAA getting started guide by @jlaneve in #846
- Fix typo related to exporting docs to GCS by @tboutaour in #922
- Improve partial parsing docs by @tatiana in #898
- Improve docs for datasets for airflow >= 2.4 by @SiddiqueAhmad in #879
- Improve test behaviour docs to highlight
warning
feature in thevirtualenv
mode by @mc51 in #910 - Fix docs typo by @SiddiqueAhmad in #917
- Improve Astro docs by @RNHTTR in #951
Others
- Add performance integration tests by @jlaneve in #827
- Enable
append_env
inoperator_args
by default by @tatiana in #899 - Change default
append_env
behaviour depending on CosmosExecutionMode
by @pankajkoti and @pankajastro in #954 - Expose the
dbt
graph in theDbtToAirflowConverter
class by @tommyjxl in #886 - Improve dbt docs plugin rendering padding by @dwreeves in #876
- Add
connect_retries
to databricks profile to fix expensive integration failures by @jbandoro in #826 - Add import sorting (isort) to Cosmos by @jbandoro in #866
- Add Python 3.11 to CI/tests by @tatiana and @jbandoro in #821, #824 and #825
- Fix failing
test_created_pod
forapache-airflow-providers-cncf-kubernetes
after v8.0.0 update by @jbandoro in #854 - Extend
DatabricksTokenProfileMapping
test to include session properties by @tatiana in #858 - Fix broken integration test uncovered from Pytest 8.0 update by @jbandoro in #845
- Add Apache Airflow 2.9 to the test matrix by @tatiana in #940
- Replace deprecated
DummyOperator
byEmptyOperator
if Airflow >=2.4.0 by @tatiana in #900 - Improve logs to troubleshoot issue in 1.4.0a2 with astro-cli by @tatiana in #947
- Fix issue when publishing a new release to PyPI by @tatiana in #946
- Pre-commit hook updates in #820, #834, #843 and #852, #890, #896, #901, #905, #908, #919, #931, #941
v1.4.0rc1
Features
- Add dbt docs natively in Airflow via plugin by @dwreeves in #737
- Add support for
InvocationMode.DBT_RUNNER
for local execution mode by @jbandoro in #850 - Support partial parsing to render DAGs faster when using
ExecutionMode.LOCAL
,ExecutionMode.VIRTUALENV
andLoadMode.DBT_LS
by @dwreeves in #800 - Improve performance by 22-35% or more by caching partial parse artefact by @tatiana in #904
- Add Azure Container Instance as Execution Mode by @danielvdende in #771
- Add dbt build operators by @dylanharper-qz in #795
- Add dbt profile config variables to mapped profile by @ykuc in #794
- Add more template fields to
DbtBaseOperator
by @dwreeves in #786 - Add
pip_install_options
argument to operators by @octiva in #808
Bug fixes
- Make
PostgresUserPasswordProfileMapping
schema argument optional by @FouziaTariq in #683 - Fix
folder_dir
not showing on logs forDbtDocsS3LocalOperator
by @PrimOox in #856 - Improve
dbt ls
parsing resilience to missing tags/config by @tatiana in #859 - Fix
operator_args
modified in place in Airflow converter by @jbandoro in #835 - Fix Docker and Kubernetes operators execute method resolution by @jbandoro in #849
- Fix
TrinoBaseProfileMapping
required parameter for non method authentication by @AlexandrKhabarov in #921 - Fix global flags for lists by @ms32035 in #863
- Fix
GoogleCloudServiceAccountDictProfileMapping
when getting values from the Airflow connectionextra__
keys by @glebkrapivin in #923 - Fix using the dag as a keyword argument as
specific_args_keys
in DbtTaskGroup by @tboutaour in #916 - Fix ACI integration (
DbtAzureContainerInstanceBaseOperator
) by @danielvdende in #872 - Fix setting dbt project dir to the tmp dir by @dwreeves in #873
- Fix dbt docs operator to not use
graph.gpickle
file when--no-write-json
is passed by @dwreeves in #883 - Make Pydantic a required dependency by @pankajkoti in #939
- Gracefully error if users try to
emit_datasets
withAirflow 2.9.0
or2.9.1
by @tatiana in #948 - Fix parsing tests that have no parents in #933 by @jlaneve
- Correct
root_path
in partial parse cache by @pankajkoti in #950
Docs
- Fix docs homepage link by @jlaneve in #860
- Fix docs
ExecutionConfig.dbt_project_path
by @jbandoro in #847 - Fix typo in MWAA getting started guide by @jlaneve in #846
- Fix typo related to exporting docs to GCS by @tboutaour in #922
- Improve partial parsing docs by @tatiana in #898
- Improve docs for datasets for airflow >= 2.4 by @SiddiqueAhmad in #879
- Improve test behaviour docs to highlight
warning
feature in thevirtualenv
mode by @mc51 in #910 - Fix docs typo by @SiddiqueAhmad in #917
- Improve Astro docs by @RNHTTR in #951
Others
- Add performance integration tests by @jlaneve in #827
- Enable
append_env
inoperator_args
by default by @tatiana in #899 - Expose the
dbt
graph in theDbtToAirflowConverter
class by @tommyjxl in #886 - Improve dbt docs plugin rendering padding by @dwreeves in #876
- Add
connect_retries
to databricks profile to fix expensive integration failures by @jbandoro in #826 - Add import sorting (isort) to Cosmos by @jbandoro in #866
- Add Python 3.11 to CI/tests by @tatiana and @jbandoro in #821, #824 and #825
- Fix failing
test_created_pod
forapache-airflow-providers-cncf-kubernetes
after v8.0.0 update by @jbandoro in #854 - Extend
DatabricksTokenProfileMapping
test to include session properties by @tatiana in #858 - Fix broken integration test uncovered from Pytest 8.0 update by @jbandoro in #845
- Add Apache Airflow 2.9 to the test matrix by @tatiana in #940
- Replace deprecated
DummyOperator
byEmptyOperator
if Airflow >=2.4.0 by @tatiana in #900 - Improve logs to troubleshoot issue in 1.4.0a2 with astro-cli by @tatiana in #947
- Fix issue when publishing a new release to PyPI by @tatiana in #946
- Pre-commit hook updates in #820, #834, #843 and #852, #890, #896, #901, #905, #908, #919, #931, #941
v1.4.0a4
Features
- Add dbt docs natively in Airflow via plugin by @dwreeves in #737
- Add support for
InvocationMode.DBT_RUNNER
for local execution mode by @jbandoro in #850 - Support partial parsing to render DAGs faster when using
ExecutionMode.LOCAL
,ExecutionMode.VIRTUALENV
andLoadMode.DBT_LS
by @dwreeves in #800 - Improve performance by 22-35% or more by caching partial parse artefact by @tatiana in #904
- Add Azure Container Instance as Execution Mode by @danielvdende in #771
- Add dbt build operators by @dylanharper-qz in #795
- Add dbt profile config variables to mapped profile by @ykuc in #794
- Add more template fields to
DbtBaseOperator
by @dwreeves in #786 - Add
pip_install_options
argument to operators by @octiva in #808
Bug fixes
- Make
PostgresUserPasswordProfileMapping
schema argument optional by @FouziaTariq in #683 - Fix
folder_dir
not showing on logs forDbtDocsS3LocalOperator
by @PrimOox in #856 - Improve
dbt ls
parsing resilience to missing tags/config by @tatiana in #859 - Fix
operator_args
modified in place in Airflow converter by @jbandoro in #835 - Fix Docker and Kubernetes operators execute method resolution by @jbandoro in #849
- Fix
TrinoBaseProfileMapping
required parameter for non method authentication by @AlexandrKhabarov in #921 - Fix global flags for lists by @ms32035 in #863
- Fix
GoogleCloudServiceAccountDictProfileMapping
when getting values from the Airflow connectionextra__
keys by @glebkrapivin in #923 - Fix using the dag as a keyword argument as
specific_args_keys
in DbtTaskGroup by @tboutaour in #916 - Fix ACI integration (
DbtAzureContainerInstanceBaseOperator
) by @danielvdende in #872 - Fix setting dbt project dir to the tmp dir by @dwreeves in #873
- Fix dbt docs operator to not use
graph.gpickle
file when--no-write-json
is passed by @dwreeves in #883 - Make Pydantic a required dependency by @pankajkoti in #939
Docs
- Fix docs homepage link by @jlaneve in #860
- Fix docs
ExecutionConfig.dbt_project_path
by @jbandoro in #847 - Fix typo in MWAA getting started guide by @jlaneve in #846
- Fix typo related to exporting docs to GCS by @tboutaour in #922
- Improve partial parsing docs by @tatiana in #898
- Improve docs for datasets for airflow >= 2.4 by @SiddiqueAhmad in #879
- Improve test behaviour docs to highlight
warning
feature in thevirtualenv
mode by @mc51 in #910 - Fix docs typo by @SiddiqueAhmad in #917
Others
- Add performance integration tests by @jlaneve in #827
- Enable
append_env
inoperator_args
by default by @tatiana in #899 - Expose the
dbt
graph in theDbtToAirflowConverter
class by @tommyjxl in #886 - Improve dbt docs plugin rendering padding by @dwreeves in #876
- Add
connect_retries
to databricks profile to fix expensive integration failures by @jbandoro in #826 - Add import sorting (isort) to Cosmos by @jbandoro in #866
- Add Python 3.11 to CI/tests by @tatiana and @jbandoro in #821, #824 and #825
- Fix failing
test_created_pod
forapache-airflow-providers-cncf-kubernetes
after v8.0.0 update by @jbandoro in #854 - Extend
DatabricksTokenProfileMapping
test to include session properties by @tatiana in #858 - Fix broken integration test uncovered from Pytest 8.0 update by @jbandoro in #845
- Replace deprecated
DummyOperator
byEmptyOperator
if Airflow >=2.4.0 by @tatiana in #900 - Add Apache Airflow 2.9 to the test matrix by @tatiana in #940
- Improve DEBUG logs when creating Datasets
- Fix workflow to publish Cosmos packages
- Pre-commit hook updates in #820, #834, #843 and #852, #890, #896, #901, #905, #908, #919, #931, #941
v1.4.0a2
Features
- Add dbt docs natively in Airflow via plugin by @dwreeves in #737
- Add support for
InvocationMode.DBT_RUNNER
for local execution mode by @jbandoro in #850 - Support partial parsing to render DAGs faster when using
ExecutionMode.LOCAL
,ExecutionMode.VIRTUALENV
andLoadMode.DBT_LS
by @dwreeves in #800 - Improve performance by 22-35% or more by caching partial parse artefact by @tatiana in #904
- Add Azure Container Instance as Execution Mode by @danielvdende in #771
- Add dbt build operators by @dylanharper-qz in #795
- Add dbt profile config variables to mapped profile by @ykuc in #794
- Add more template fields to
DbtBaseOperator
by @dwreeves in #786 - Add
pip_install_options
argument to operators by @octiva in #808
Bug fixes
- Make
PostgresUserPasswordProfileMapping
schema argument optional by @FouziaTariq in #683 - Fix
folder_dir
not showing on logs forDbtDocsS3LocalOperator
by @PrimOox in #856 - Improve
dbt ls
parsing resilience to missing tags/config by @tatiana in #859 - Fix
operator_args
modified in place in Airflow converter by @jbandoro in #835 - Fix Docker and Kubernetes operators execute method resolution by @jbandoro in #849
- Fix
TrinoBaseProfileMapping
required parameter for non method authentication by @AlexandrKhabarov in #921 - Fix global flags for lists by @ms32035 in #863
- Fix
GoogleCloudServiceAccountDictProfileMapping
when getting values from the Airflow connectionextra__
keys by @glebkrapivin in #923 - Fix using the dag as a keyword argument as
specific_args_keys
in DbtTaskGroup by @tboutaour in #916 - Fix ACI integration (
DbtAzureContainerInstanceBaseOperator
) by @danielvdende in #872 - Fix setting dbt project dir to the tmp dir by @dwreeves in #873
- Fix dbt docs operator to not use
graph.gpickle
file when--no-write-json
is passed by @dwreeves in #883
Docs
- Fix docs homepage link by @jlaneve in #860
- Fix docs
ExecutionConfig.dbt_project_path
by @jbandoro in #847 - Fix typo in MWAA getting started guide by @jlaneve in #846
- Fix typo related to exporting docs to GCS by @tboutaour in #922
- Improve partial parsing docs by @tatiana in #898
- Improve docs for datasets for airflow >= 2.4 by @SiddiqueAhmad in #879
- Improve test behaviour docs to highlight
warning
feature in thevirtualenv
mode by @mc51 in #910 - Fix docs typo by @SiddiqueAhmad in #917
Others
- Add performance integration tests by @jlaneve in #827
- Enable
append_env
inoperator_args
by default by @tatiana in #899 - Expose the
dbt
graph in theDbtToAirflowConverter
class by @tommyjxl in #886 - Improve dbt docs plugin rendering padding by @dwreeves in #876
- Add
connect_retries
to databricks profile to fix expensive integration failures by @jbandoro in #826 - Add import sorting (isort) to Cosmos by @jbandoro in #866
- Add Python 3.11 to CI/tests by @tatiana and @jbandoro in #821, #824 and #825
- Fix failing
test_created_pod
forapache-airflow-providers-cncf-kubernetes
after v8.0.0 update by @jbandoro in #854 - Extend
DatabricksTokenProfileMapping
test to include session properties by @tatiana in #858 - Fix broken integration test uncovered from Pytest 8.0 update by @jbandoro in #845
- Pre-commit hook updates in #820, #834, #843 and #852, #890, #896, #901, #905, #908, #919, #931
- Replace deprecated
DummyOperator
byEmptyOperator
if Airflow >=2.4.0 by @tatiana in #900