Skip to content

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

License

Notifications You must be signed in to change notification settings

vhive-serverless/airflow

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

License

Airflow-vHive: Workflow Programming and Orchestration with Airflow atop of the vHive Serverless Platform

This fork of Apache Airflow executes DAGs similarly to the Kubernetes Executor shipped with stock Apache Airflow. However, instead of creating and deleting Kubernetes pods to execute tasks, it uses Knative services.

These Knative services must be created ahead of time. However, as Knative works differently, this does not mean that a worker pod is running all time. Instead, Knative creates/scales/deletes the pods automatically as needed. Also, this Knative worker function works seamlessly with other Airflow components, to maximize compatibility.

Airflow Architecture

Airflow-vHive_Architecture

Getting started with Airflow-vHive

Please take a look at Quickstart Guide

Developing Airflow-vHive

Please take a look at Developer's Guide

License and copyright

This fork inherits the license and copyright of the original Apache/Airflow. This code is published under the terms of the Apache 2 license.

The software is maintained by the HyScale Lab in the Nanyang Technological University, Singapore and vHive community.

Maintainer

About

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 96.1%
  • TypeScript 2.1%
  • Shell 0.6%
  • HTML 0.5%
  • JavaScript 0.4%
  • Jinja 0.1%
  • Other 0.2%