nmp-scheduler

The scheduler component for NWPC Monitor Platform.

nmp-scheduler uses celery to collect status for workflow systems, workload systems and HPC disk usage .

WARN: Only workflow collectors are maintained currently.

Install

Install the following python packages from github:

• nwpc-workflow-model

Install nmp-scheduler using pip.

Create all config files needed by collectors. And set config directory's path to NWPC_MONITOR_TASK_SCHEDULER_CONFIG environment variable before running any workers.

Getting Started

Run celery workers. Each worker should have an unique name and listen on some queues.

python3 nmp_scheduler/run.py worker --name=celery --queues=celery
python3 nmp_scheduler/run.py worker --name=ecflow --queues=nmp_ecflow

Run celery beat to enable schedulers.

python3 nmp_scheduler/run.py beat

Docker

Build docker images using:

docker build -t nwpc-oper/nmp-scheduler --rm .

Collectors

Workflow systems

ecFlow

• ecflow-client-cpp
• nwpc-ecflow-collector

SMS

• nwpc-sms-collector

License

Copyright 2019-2020, perillaroc at nwpc-oper.

nmp-scheduler is licensed under GPL-3.0.