Tool report aggregation and prioritisation project

[bgruening]

The motivation is to pull together tool error reports and get a better overview of how we spent our tool-fixing-capacity effectively.

[bgruening]

@neoformit can you maybe add a summary of our discussion here? What needs to be done and if/how we can help?

[neoformit]

We would like to send tool error reports to Sentry (the galaxyproject server). To make these reports more useful for identifying problematic tools we would like to update the sentry.py tool error plugin to include a measure of total tool runs (probably run count in last 30 days).

Sentry seems to be capable of most of the features we require, such as clustering and enumeration of error messages and version tracking.

[bgruening]

@neoformit do you have access to sentry? Does this idea work for you, can we close this issue?

[neoformit]

Yep, I think it's good. I haven't had time to work on it yet unfortunately.

[bgruening]

Some improvements are here: galaxyproject/galaxy#16686