Skip to content

This is a simple action that helps you to fetch your Apache Airflow DAGs to Google Cloud Composer

License

Notifications You must be signed in to change notification settings

cristian-rincon/action-composer-sync

Use this GitHub action with your project
Add this Action to an existing workflow or create a new one
View on Marketplace

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Github action | Sync Airflow DAGs to Google Cloud Composer

This action helps you to fetch your Apache Airflow DAGs to Google Cloud Composer. The action expect GOOGLE_APPLICATION_CREDENTIALS encoded as base64.

It's highly recommended to save your credentials as Encrypted secrets and read them from {{ secrets.GOOGLE_APPLICATION_CREDENTIALS }}.

More information about Encrypted Secrets.

Github actions steps

Set credentials

Enable GOOGLE_APPLICATION_CREDENTIALS in the context.

Sync DAGs

This action will fetch your DAGs from Apache Airflow and push them to Google Cloud Composer.

Inputs

  • GOOGLE_APPLICATION_CREDENTIALS: The base64 encoded credentials.
  • PROJECT_ID: The Google project ID.
  • ENVIRONMENT: The Google Cloud Composer environment name.
  • LOCATION: The Google Cloud Composer environment location.
  • DAG_NAME: DAGs folder name.

Example usage

name: Sync Airflow DAGs to Google Cloud Composer
uses: cristian-rincon/[email protected]
with:
    GOOGLE_APPLICATION_CREDENTIALS: "${{ secrets.GOOGLE_APPLICATION_CREDENTIALS }}"
    PROJECT_ID: "${{ secrets.PROJECT_ID }}"
    ENVIRONMENT: "${{ secrets.ENVIRONMENT }}"
    LOCATION: "${{ secrets.LOCATION }}"
    DAG_NAME: "${{ secrets.DAG_NAME }}"

About

This is a simple action that helps you to fetch your Apache Airflow DAGs to Google Cloud Composer

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published