Create an airflow instance on Kubernetes

[sync-by-unito]

We need an Airflow environment that closes represents an actual Kubernetes instance.

They use a helm chart so we should also use a helm chart.

https://airflow.apache.org/docs/helm-chart/stable/index.html

a) Install the helm chart.
b) Set up a dag examples repo

┆Issue is synchronized with this Jira Task by Unito

[sync-by-unito]

➤ Kevin Hannon commented:

https://github.com/kannon92/armada-demo

I’ve created a demo repo where I run airflow locally and jobservice and point to our eks demo cluster. I’d love to get a helm chart install of airflow that works on kind.

[sync-by-unito]

➤ VasuDevrani commented:

Hey @kannon92, I'm kinda beginner in this, armadaproject
I would appreciate if you could break this task down for me. Like exactly what I am supposed to do here.
And, by the way I'm well versed with helm charts and kubernetes.

thanks

[kannon92]

Mostly it’s about installing airflow via a helm chart, importing the dags from that demo and have it work with Armada.

You could use the EKS demo cluster as your Armada environment.

[sync-by-unito]

➤ Kevin Hannon commented:

There is a ticket around code coverage increase if you want more familiarity with the code base