Releases: astronomer/astronomer-cosmos
v1.1.0a2
v1.1.0a1
Feature (pending documentation!)
Enhancements
Bug fixes
- Fix bug on select node add exclude selector subset ids logic by @jensenity in #463
- Refactor dbt ls to run from a temporary directory to avoid Read-only file system errors during DAG parsing, by @tatiana in #414
Others
- Docs: Fix RenderConfig load argument by @jbandoro in #466
- Enable CI integration tests from external forks by @tatiana in #458
- Improve CI tests runtime by @tatiana in #457
- Change CI to run coverage after tests pass by @tatiana in #461
- Fix forks code revision in code coverage by @tatiana in #472
- [pre-commit.ci] pre-commit auto-update by @pre-commit-ci in #467
v1.4.0a3
Features
- Add dbt docs natively in Airflow via plugin by @dwreeves in #737
- Add support for
InvocationMode.DBT_RUNNER
for local execution mode by @jbandoro in #850 - Support partial parsing to render DAGs faster when using
ExecutionMode.LOCAL
,ExecutionMode.VIRTUALENV
andLoadMode.DBT_LS
by @dwreeves in #800 - Improve performance by 22-35% or more by caching partial parse artefact by @tatiana in #904
- Add Azure Container Instance as Execution Mode by @danielvdende in #771
- Add dbt build operators by @dylanharper-qz in #795
- Add dbt profile config variables to mapped profile by @ykuc in #794
- Add more template fields to
DbtBaseOperator
by @dwreeves in #786 - Add
pip_install_options
argument to operators by @octiva in #808
Bug fixes
- Make
PostgresUserPasswordProfileMapping
schema argument optional by @FouziaTariq in #683 - Fix
folder_dir
not showing on logs forDbtDocsS3LocalOperator
by @PrimOox in #856 - Improve
dbt ls
parsing resilience to missing tags/config by @tatiana in #859 - Fix
operator_args
modified in place in Airflow converter by @jbandoro in #835 - Fix Docker and Kubernetes operators execute method resolution by @jbandoro in #849
- Fix
TrinoBaseProfileMapping
required parameter for non method authentication by @AlexandrKhabarov in #921 - Fix global flags for lists by @ms32035 in #863
- Fix
GoogleCloudServiceAccountDictProfileMapping
when getting values from the Airflow connectionextra__
keys by @glebkrapivin in #923 - Fix using the dag as a keyword argument as
specific_args_keys
in DbtTaskGroup by @tboutaour in #916 - Fix ACI integration (
DbtAzureContainerInstanceBaseOperator
) by @danielvdende in #872 - Fix setting dbt project dir to the tmp dir by @dwreeves in #873
- Fix dbt docs operator to not use
graph.gpickle
file when--no-write-json
is passed by @dwreeves in #883 - Make Pydantic a required dependency by @pankajkoti in #939
Docs
- Fix docs homepage link by @jlaneve in #860
- Fix docs
ExecutionConfig.dbt_project_path
by @jbandoro in #847 - Fix typo in MWAA getting started guide by @jlaneve in #846
- Fix typo related to exporting docs to GCS by @tboutaour in #922
- Improve partial parsing docs by @tatiana in #898
- Improve docs for datasets for airflow >= 2.4 by @SiddiqueAhmad in #879
- Improve test behaviour docs to highlight
warning
feature in thevirtualenv
mode by @mc51 in #910 - Fix docs typo by @SiddiqueAhmad in #917
Others
- Add performance integration tests by @jlaneve in #827
- Enable
append_env
inoperator_args
by default by @tatiana in #899 - Expose the
dbt
graph in theDbtToAirflowConverter
class by @tommyjxl in #886 - Improve dbt docs plugin rendering padding by @dwreeves in #876
- Add
connect_retries
to databricks profile to fix expensive integration failures by @jbandoro in #826 - Add import sorting (isort) to Cosmos by @jbandoro in #866
- Add Python 3.11 to CI/tests by @tatiana and @jbandoro in #821, #824 and #825
- Fix failing
test_created_pod
forapache-airflow-providers-cncf-kubernetes
after v8.0.0 update by @jbandoro in #854 - Extend
DatabricksTokenProfileMapping
test to include session properties by @tatiana in #858 - Fix broken integration test uncovered from Pytest 8.0 update by @jbandoro in #845
- Replace deprecated
DummyOperator
byEmptyOperator
if Airflow >=2.4.0 by @tatiana in #900 - Add Apache Airflow 2.9 to the test matrix by @tatiana in #940
- Improve DEBUG logs when creating Datasets
- Pre-commit hook updates in #820, #834, #843 and #852, #890, #896, #901, #905, #908, #919, #931, #941
v1.0.5
Enhancements
- Improve logs to include astronomer-cosmos identifier by @tatiana in #450
- Support OAuth authentication for Big Query by @MonideepDe in #431
Bug fixes
- Fix selector for config tags by @javihernovoa in #441
- Fix BigQuery keyfile_dict mapping for connection created from webserver UI by @jbandoro in #449
Others
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #446
- Resolve MyPy errors when adding Airflow pre-commit dependency by @abhi12mohan in #434
v1.0.4
What's Changed
- fix arg name to match by @harels in #415
- ⬆ [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #418
- Allow profiles_yml_filepath to be a str type by @CorsettiS in #419
- Fix integration tests by @jlaneve in #426
- Resolving "Crash when adding sources.yml" by @abhi12mohan in #423
- bump version by @jlaneve in #430
- Flag invalid select/exclude using custom mode by @abhi12mohan in #428
Full Changelog: astronomer-cosmos-v1.0.3...astronomer-cosmos-v1.0.4
v1.0.3
What's Changed
- Fix bug causing select and exclude filter issues by @chrishronek in #410
Full Changelog: astronomer-cosmos-v1.0.2...astronomer-cosmos-v1.0.3
v1.0.2
What's Changed
Full Changelog: astronomer-cosmos-v1.0.2a1...astronomer-cosmos-v1.0.2
v1.0.1
This release contains critical bug fixes after the 1.0.0 release.
What's Changed
- Update docs structure and add getting started guides by @jlaneve in #374
- Fix bug where dbt_executable_path was not passed to operators by @jlaneve in #397
- fix: README - image by @raphaelauv in #404
- fix: README - imports by @raphaelauv in #403
- attempt to fix profiles bug by @jlaneve in #406
- add .env for a straightforward dev deployment by @CorsettiS in #354
- update graph parsing mode when virtualenv is selected by @CorsettiS in #402
- Add default group_id to init params by @chrishronek in #399
New Contributors
- @raphaelauv made their first contribution in #404
Full Changelog: astronomer-cosmos-v1.0.0...astronomer-cosmos-v1.0.1
v1.0.2a1
Full Changelog: astronomer-cosmos-v1.0.1...astronomer-cosmos-v1.0.2a1
v1.0.0
This is a the first major version release of Cosmos! Please notice there are quite a few breaking changes.
This release includes a simplified config interface and introduces dbt loading modes that align more closely with how users would expect dbt to behave.
Here's an example of the new config interface:
`from cosmos import DbtDag
profile_config = ProfileConfig(
profile_name="default",
target_name="dev",
profile_mapping=PostgresUserPasswordProfileMapping(
conn_id="airflow_db",
profile_args={"schema": "public"},
),
)
my_cosmos_dag = DbtDag(
project_config=ProjectConfig(
"/usr/local/airflow/dags/my_dbt_project",
),
profile_config=profile_config,
# normal dag parameters
schedule_interval="@daily",
start_date=datetime(2023, 1, 1),
catchup=False,
dag_id="my_cosmos_dag",
)`
What's Changed
- Fix BQ connection parsing with dataset info by @MonideepDe in #367
- [BREAKING] Refactor dbt project parsing and Airflow DAG generation by @tatiana in #360
- ⬆ [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #373
- Snowflake private key by @patawan in #378
- Change
test_behavior
andexecution_mode
to useEnum
as opposed to Literals by @tatiana in #379 - Add support to run dbt Python models by @tatiana in #375
- Add support to GCP connections that define
keyfile_dict
instead ofkeyfile
by @JoeSham in #352 - Resolve MyPy errors in Cosmos pre-commit by @abhi12mohan in #377
- Ignore
.user.yml
files by @tatiana in #386 - ⬆ [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #388
- **[BREAKING]**Initial implementation of simplifying config interfaces by @jlaneve in #389
- Support user-supplied profiles by @jlaneve in #390
- Update README.rst by @harels in #394
- bump version to 1.0.0 by @harels in #395
New Contributors
- @MonideepDe made their first contribution in #367
- @JoeSham made their first contribution in #352
- @abhi12mohan made their first contribution in #377
Full Changelog: astronomer-cosmos-v0.7.5...astronomer-cosmos-v1.0.0