Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] executor_config not working when using Kubernetes Executor #376

Open
1 task
nicolasge opened this issue Feb 23, 2025 · 0 comments
Open
1 task

[Bug] executor_config not working when using Kubernetes Executor #376

nicolasge opened this issue Feb 23, 2025 · 0 comments
Labels
bug Something isn't working triage-needed

Comments

@nicolasge
Copy link

DAG Factory version

0.22

airflow version

2.10.5

Python version

3.12

Deployment

Official Apache Airflow Helm Chart

Deployment details

Nothing special, the deployment is running on an openshift cluster using Kubernetes Executor only.

What happened?

  1. All tasks with executor_config are not able to run, scheduler complains: INVALID executor_config config
  2. When we use executor_config, we just want to override some of the specs(for instance resource limits), but dag-factory tried to clean all the executor_config generated by Scheduler, then use the one we defined. It should be inherit then override, now it's clean flush then set only the values we defined.

Relevant log output

How to reproduce

Any task with executor_config pod_override settings, for instance resource limits.

Anything else :)?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Contact Details

No response

@nicolasge nicolasge added bug Something isn't working triage-needed labels Feb 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working triage-needed
Projects
None yet
Development

No branches or pull requests

1 participant