Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PoC to use Airflow 2.10.0b1 DatasetAlias in Cosmos #1135

Open
4 tasks
tatiana opened this issue Aug 1, 2024 · 0 comments
Open
4 tasks

PoC to use Airflow 2.10.0b1 DatasetAlias in Cosmos #1135

tatiana opened this issue Aug 1, 2024 · 0 comments
Labels
area:datasets Related to the Airflow datasets feature/module
Milestone

Comments

@tatiana
Copy link
Collaborator

tatiana commented Aug 1, 2024

Context

This ticket aims to PoC on the following:

We should reach out to @Lee-W giving feedback.

More context in the epic:
#1119

Acceptance criteria

  • Confirm that we can use DatasetAlias
  • Confirm that the issue Airflow orphaning unreferenced Dataset URIs in Cosmos 1.1 #522 is resolved
  • Confirm that the Datasets / Dataset Aliases are behaving well in the Airflow UI
  • Log follow-up tasks to deliver this feature to production (ideally, we'd also analyze and improve the availability of this feature, ATM it is only available for ExecutionMode.LOCAL and ExecutionMode.VIRTUALENV)
@tatiana tatiana changed the title PoC to use Airflow 2.10.0b1 DatasetAliass in Cosmos PoC to use Airflow 2.10.0b1 DatasetAlias in Cosmos Aug 1, 2024
@dosubot dosubot bot added the area:datasets Related to the Airflow datasets feature/module label Aug 1, 2024
@pankajkoti pankajkoti added this to the Cosmos 1.7.0 milestone Sep 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:datasets Related to the Airflow datasets feature/module
Projects
None yet
Development

No branches or pull requests

2 participants