Want benchmarking tool for OxQL

[bnaecker]

It would be very nice to have a tool that lets us benchmark the OxQL implementation. I'd like to track at least the total query duration, and for each ClickHouse SQL query we run: (1) duration, (2) maximum memory consumption, (3) maximum CPU usage.

We already keep track of the IDs of each ClickHouse SQL query in the QueryResults that are returned from the OxQL interface, so I could imagine a tool that:

• Loads some data of various sizes (number of fields and number of samples)
• Runs some range of queries
• Asks ClickHouse via the system.query_log table for the details of all the contained queries
• Spits it out into a simple format like CSV, so we can print summaries or statistics, make plots, etc.