Releases: astronomer/astronomer-cosmos
v1.5.0rc2
v1.7.1
Bug fixes
- Fix
DbtVirtualenvBaseOperator
to use correct virtualenv Python path by @kesompochy in #1252 - Fix displaying dbt docs as menu item in Astro by @tatiana in #1280
- Fix: Replace login by user for clickhouse profile by @petershenri in #1255
Enhancements
- Improve dbt Docs Hosting Debugging -- Update dbt_docs_not_set_up.html by @johnmcochran in #1250
- Minor refactor on VirtualenvOperators & add test for PR #1253 by @tatiana in #1286
Docs
- Add Welcome Section and "What Is Cosmos" Blurb to Home Page by @cmarteepants and @yanmastin-astro in #1251
- Update the URL for sample dbt docs hosted in Astronomer S3 bucket by @pankajkoti in #1283
- Add dedicated scarf tracking pixel to readme by @cmarteepants in #1256
Others
- Update
CODEOWNERS
to track all files by @pankajkoti in #1284 - Fix release after the
raw
rst directive was disabled in PyPI by @tatiana in #1282 - Update issue template
bug.yml
- cosmos version update in the dropdown by @pankajkoti in #1275 - Pre-commit hook updates in #1285, #1274, #1254, #1244
v1.7.1a3
v1.7.1a2
v1.7.1a1
v1.7.0
New Features
-
Support using
DatasetAlias
and fix orphaning unreferenced dataset by @tatiana in #1217 #1240Documentation: https://astronomer.github.io/astronomer-cosmos/configuration/scheduling.html#data-aware-scheduling
-
Add GCP_CLOUD_RUN_JOB execution mode by @ags-de #1153
Learn more about it: https://astronomer.github.io/astronomer-cosmos/getting_started/gcp-cloud-run-job.html
-
Introduction of experimental support to run dbt BQ models using Airflow deferrable operators by @pankajkoti @pankajastro @tatiana in #1224 #1230.
This is the first step in the journey of running dbt resources with native Airflow, and we would appreciate feedback from the community.
For more information, check the documentation: https://astronomer.github.io/astronomer-cosmos/getting_started/execution-modes.html#airflow-async-experimental
This work has been inspired by the talk "Airflow at Monzo: Evolving our data platform as the bank scales" by
@jonathanrainer @ed-sparkes given at Airflow Summit 2023: https://airflowsummit.org/sessions/2023/airflow-at-monzo-evolving-our-data-platform-as-the-bank-scales/.
Enhancements
- Create single virtualenv when
DbtVirtualenvBaseOperator
hasvirtualenv_dir=None
andis_virtualenv_dir_temporary=True
by @kesompochy in #1200 - Consistently handle build and imports in
cosmos/__init__.py
by @tatiana in #1215 - Add enum constants to init for direct import by @fabiomx in #1184
Bug fixes
- URL encode dataset names to support multibyte characters by @t0momi219 in #1198
- Fix invalid argument (
full_refresh
) passed to DbtTestAwsEksOperator (and others) by @johnhoran in #1175 - Fix
printer_width
arg type inDbtProfileConfigVars
by @jessicaschueler in #1191 - Fix task owner fallback by @jmaicher in #1195
Docs
- Add scarf to readme and docs for website analytics by @cmarteepants in #1221
- Add
virtualenv_dir
param toExecutionConfig
docs by @pankajkoti in #1173 - Give credits to @LennartKloppenburg in CHANGELOG.rst by @tatiana #1174
- Refactor docs for async mode execution by @pankajkoti in #1241
Others
- Remove PR branch added for testing a change in CI in #1224 by @pankajkoti in #1233
- Fix CI wrt broken coverage upload artifact @pankajkoti in #1210
- Fix CI issues - Upgrade actions/upload-artifact & actions/download-artifact to v4 and set min version for packaging by @pankajkoti in #1208
- Resolve CI failures for Apache Airflow 2.7 jobs by @pankajkoti in #1182
- CI: Update GCP manifest file path based on new secret update by @pankajkoti in #1237
- Pre-commit hook updates in #1176 #1186, #1186, #1201, #1219, #1231
v1.7.0a1
v1.6.1a1
v1.6.0
New Features
- Add support for loading manifest from cloud stores using Airflow Object Storage by @pankajkoti in #1109
- Cache
package-lock.yml
file by @pankajastro in #1086 - Support persisting the
LoadMode.VIRTUALENV
directory by @LennartKloppenburg @tatiana in #1079 - Add support to store and fetch
dbt ls
cache in remote stores by @pankajkoti in #1147 - Add default source nodes rendering by @arojasb3 in #1107
- Add Teradata
ProfileMapping
by @sc250072 in #1077
Enhancements
- Add
DatabricksOauthProfileMapping
profile by @CorsettiS in #1091 - Use
dbt ls
as the default parser whenprofile_config
is provided by @pankajastro in #1101 - Add task owner to dbt operators by @wornjs in #1082
- Extend Cosmos custom selector to support + when using paths and tags by @mvictoria in #1150
- Simplify logging by @dwreeves in #1108
Bug fixes
- Fix Teradata
ProfileMapping
target invalid issue by @sc250072 in #1088 - Fix empty tag in case of custom parser by @pankajastro in #1100
- Fix
dbt deps
ofLoadMode.DBT_LS
should useProjectConfig.dbt_vars
by @tatiana in #1114 - Fix import handling by lazy loading hooks introduced in PR #1109 by @dwreeves in #1132
- Fix Airflow 2.10 regression and add Airflow 2.10 in test matrix by @pankajastro in #1162
Docs
- Fix typo in azure-container-instance docs by @pankajastro in #1106
- Use Airflow trademark as it has been registered by @pankajastro in #1105
Others
- Run some example DAGs in Kubernetes execution mode in CI by @pankajastro in #1127
- Install requirements.txt by default during dev env spin up by @@CorsettiS in #1099
- Remove
DbtGraph.current_version
dead code by @tatiana in #1111 - Disable test for Airflow-2.5 and Python-3.11 combination in CI by @pankajastro in #1124
- Pre-commit hook updates in #1074, #1113, #1125, #1144, #1154, #1167
v1.6.0a8
Same as v1.6.0a7 and additionally below changes:
Bug fixes
- Fix Airflow 2.10 regression and add Airflow 2.10 in test matrix by @pankajastro in #1162
Others
- Pre-commit hook updates in #1167