prometheus_remote_kinesis

prometheus_remote_kinesis is a prometheus remote write storage adapter which send records to AWS Kinesis stream.

From AWS Kinesis stream, you can recieve any metrics from stream. or just store metrics to S3 via Kinesis firehose.

Usage

To build, use golang 1.9 or later.

% go get -u
% go build

Then just run it. If not specify port, use 9501 port.

$ prometheus_remote_kinesis --stream-name prometheus-backup

You can also use Docker image.

docker run -d --rm --name remote_kinesis \
   -p 9501:9501 \
   -e STREAM_NAME=prometheus-backup \
   shirou/prometheus_remote_kinesis

You can specify prometheus.yml like this.

remote_write:
  - url: http://localhost:9501/receive

Format

This adapter send Prometheus metrics as JSON. Below is a prettified, actually send one line with new line (JSON-LD format).

{
  "name": "scrape_duration_seconds",
  "time": 1513264725773,
  "value": 0.004345524,
  "labels": {
    "__name__": "scrape_duration_seconds",
    "instance": "localhost:9090",
    "job": "prometheus",
    "monitor": "codelab-monitor"
  }
}

This adapter does not send record gziped, if you use Firehose, specify gziped is recommended.

License

Apache License version 2.0