Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chapter 2 Rocket Launch DAG #49

Open
NomadAgile opened this issue Jun 6, 2021 · 3 comments
Open

Chapter 2 Rocket Launch DAG #49

NomadAgile opened this issue Jun 6, 2021 · 3 comments

Comments

@NomadAgile
Copy link

NomadAgile commented Jun 6, 2021

Running the tutorial on Digital Ocean Droplet had to make the following edits to the code to get it to run:

  1. Update Import Statements to :
    from airflow.operators.bash_operator import BashOperator
    from airflow.operators.python_operator import PythonOperator

  2. Update the curl statement in the bash command passed to the BashOperator:
    bash_command = "curl -Lk -o /tmp/launches.json 'https://ll.thespacedevs.com/2.0.0/launch/upcoming'"

@xvanausloos
Copy link

I confirmed : same issue running Airflow docker image https://hub.docker.com/r/puckel/docker-airflow
This is Airflow version 1.10.9

Fix works

@ksenia-5
Copy link

  1. When I run docker-compose up -d on mac os 14.2.1 I get the error
    no matching manifest for linux/arm64/v8 in the manifest list entries. Any suggestions of a fix

  2. If I run airflow in a Python 3.8 virtual environment the first task is successfully completed but doesn't proceed onto the second. I can't locate the launches.json file created in the first step. Could it be that the tmp directory is not persisted for the second task to use? Any ideas on how to fix?

@ksenia-5
Copy link

updating the docker-compose.yml file line 13 to:
x-airflow-image: &airflow_image apache/airflow:2.8.0-python3.10 got the docker-compose up -d working successfully.

Updating the bash command as suggested by @NomadAgile got all three tasks of the dag to run successfully.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants