Uploading framework job report from WMAgent to WMArchive

Steps uploading Framework Job report

1. When FWJR came back from worker node, JobAccountant and ErrorHandler puts the data in agent couchdb with ready state

   code link 1

# complete fwjr document
fwjrDocument = {"_id": "%s-%s" % (job["id"], job["retry_count"]),
                "jobid": job["id"],
                "retrycount": job["retry_count"],
                "archivestatus": "ready",
                "fwjr": jsonFWJR,
                "type": "fwjr"}

2. ArchiveDataReporter component polls the the data,

   [code link 2] (https://github.com/dmwm/WMCore/blob/master/src/python/WMComponent/ArchiveDataReporter/ArchiveDataPoller.py#L42)

3. convert the format for WMArchive then upload bulk data.

   code link 3

4. upload to WMArchive. (Still need to add break down upload number)

   code link 3

5. update FWJR status to "uploaded" in WMArchive.

   code link 4

6. The actual work to post requests is done by WMArchive service

   code link 5

Related code

1. converting original FWJR format to WMArchive format.

   code link 6