Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add magic loop check to speed up task execution #918

Closed
wants to merge 3 commits into from
Closed

Conversation

jlaneve
Copy link
Collaborator

@jlaneve jlaneve commented Apr 20, 2024

Description

This PR adds logic to not parse a DAG unless it's in the parse context. This is called out by Airflow's docs as a nice method to improve task efficiency, because you don't require the worker to re-parse all DAGs.

Related Issue(s)

Breaking Change?

Checklist

  • I have made corresponding changes to the documentation (if required)
  • I have added tests that prove my fix is effective or that my feature works

Copy link

netlify bot commented Apr 20, 2024

Deploy Preview for sunny-pastelito-5ecb04 ready!

Name Link
🔨 Latest commit 998c9ea
🔍 Latest deploy log https://app.netlify.com/sites/sunny-pastelito-5ecb04/deploys/66242064263fd90007509913
😎 Deploy Preview https://deploy-preview-918--sunny-pastelito-5ecb04.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

Copy link

netlify bot commented Apr 20, 2024

Deploy Preview for sunny-pastelito-5ecb04 ready!

Name Link
🔨 Latest commit 41ab9b6
🔍 Latest deploy log https://app.netlify.com/sites/sunny-pastelito-5ecb04/deploys/6624206f36d70300088a4310
😎 Deploy Preview https://deploy-preview-918--sunny-pastelito-5ecb04.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@tatiana tatiana added this to the 1.6.0 milestone May 17, 2024
@tatiana tatiana modified the milestones: Cosmos 1.6.0, Cosmos 1.7.0 Jul 30, 2024
@tatiana tatiana modified the milestones: Cosmos 1.7.0, Triage Sep 20, 2024
@tatiana tatiana removed this from the Triage milestone Oct 30, 2024
@tatiana tatiana added the stale Issue has not had recent activity or appears to be solved. Stale issues will be automatically closed label Oct 30, 2024
@tatiana tatiana closed this Oct 30, 2024
@tatiana
Copy link
Collaborator

tatiana commented Oct 30, 2024

This PR is stale because it has been open for 6 months with no activity - please, feel free to reopen or create a new one if you'd like to resume the work!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
stale Issue has not had recent activity or appears to be solved. Stale issues will be automatically closed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants