StatsHouse is a highly available, scalable, multitenant monitoring system.
Visit the StatsHouse documentation website.
StatsHouse is used in production at big scale
StatsHouse is the main monitoring system of vk.com. As of
November 2023, main StatsHouse cluster is receiving 1.2 billion metrics
per second from 22000 servers and stores 5 years of data.
StatsHouse provides high resolution, low latency data
With default metric resolution of 1 second and latency of 5 seconds,
StatsHouse makes it easy to observe things happening in great detail
immediately as they are happening.
StatsHouse provides long-term metrics storage
StatsHouse automatically downsamples high-resolution data to 1 minute and 1
hour resolutions with automatic TTL. High-resolution data is stored for 2
days, minute-resolution data is stored for a month, and hour-resolution
data is stored indefinitely.
StatsHouse is easy to operate
StatsHouse automatically works around network unavailability and individual
machine failure. Most StatsHouse components are quasi-stateless. Main
stateful component is a ClickHouse cluster which StatsHouse uses
internally as a primary data store.
StatsHouse is almost impossible to overload
StatsHouse uses explicitly configured per-second budgets for network and
disk usage, and automatically samples metrics which use more than their
fair share of the budget.
StatsHouse has a built-in UI
Built-in UI allow to interactively dig into metrics without using any query
language. It also has a simple dashboard system. For more advanced use
cases, StatsHouse provides a Grafana data source plugin as well.
The StatsHouse documentation website is currently in draft form, so please check our earlier documents as well:
- Quick start guide
- Internals (in Russian)
- Protocol and data format
- PromQL implementation notes (in Russian)
- HighLoad++ 2022 (in Russian): video, slides
- Linkmeup sysadmins podcast №42 (in Russian)
StatsHouse is licensed under the Mozilla Public License Version 2.0.
