MONIT and AMQ support in WMArchvie

How to write WMArchive to CERN MONIT Broker

Upon discussion during CMS C&O offline meeting [1] it was decided to store aggregated WMArchive information into CERN IT MONIT system. To do that we add StompAMQ support to WMCore [2] and WMArchive [3]. In order to use StompAMQ and send data to CERN MONIT system someone will need to do the following:

• create wma_broker.json file with the following content: { "username":"user", "password":"password", "producer":"CMS WMArchive StompAMQ", "topic":"/topic/cms.jobmon.wmarchive", "host_and_ports":"dashb-test-mb.cern.ch:61113" }
• setup WMA_BROKER environment to point to wma_broker.json file (optional see step below)
• run myspark job with --amq option with wma_broker.json file, e.g. myspark --amq=wma_broker.json --script=RecordAggregator or if WMA_BROKER environment is in use myspark --amq=True --script=RecordAggregator

The myspark job will create a new snapshot of WMArchvie aggregated data and sends them to CERN MONIT Broker via WMCore StompAMQ class.

1. https://indico.cern.ch/event/581102/, https://indico.cern.ch/event/581102/contributions/2362067/attachments/1369485/2076320/Monit_CMS_week_201611.pdf
2. https://github.com/dmwm/WMCore/blob/master/src/python/WMCore/Services/StompAMQ/StompAMQ.py
3. https://github.com/dmwm/WMArchive/pull/290/files