Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scheduler Not Queueing up Tasks #19

Open
minh5 opened this issue Dec 1, 2017 · 2 comments
Open

Scheduler Not Queueing up Tasks #19

minh5 opened this issue Dec 1, 2017 · 2 comments

Comments

@minh5
Copy link

minh5 commented Dec 1, 2017

I'm using a slightly different configuration of this repo but I noticed that my Scheduler is not queueing up tasks even though my CeleryExecutors are able to fire off tasks through the CLI or Web UI.

I'm wondering if there is good reason to hardcore the Celery Broker URL and backend to amqp://airflow:airflow@rabbitmq:5672/airflow rather than using something like amqp://$RABBITMQ_CREDS@$RABBITMQ_PORT_15672_TCP_ADDR:$RABBITMQ_SERVICE_PORT_NODE/$RABBITMQ_DEFAULT_VHOST where the host is dynamic? I've tried both methods and my scheduler is not queuing up tasks although it is constantly sending heartbeats.

@gsemet
Copy link
Contributor

gsemet commented Dec 2, 2017

Look if the workers are connected, if so, scheduler might be dead

@minh5
Copy link
Author

minh5 commented Dec 2, 2017

Thanks @stibbons I've been debugging and I've checked that the Workers are connected to the RabbitMQ - the worker pod shows the message that I expected when deploying on a single server. Flower also picked up the tasks and was able to log it as well.

How would I check if a Scheduler is dead? Do you know if the scheduler is heartbeating the Broker URL or the metaDB?

Some of my configs:
sql_alchemy_conn = postgresql+psycopg2://username:password@localhost/db
broker_url = amqp://airflow:airflow@$RABBITMQ_SERVICE_HOST:5672/airflow
celery_result_backend = postgresql+psycopg2://username:password@localhost/db # I've also tried with the amqp but no luck

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants