Skip to content

eladamitpxi/spark-statsd

 
 

Repository files navigation

spark-statsd

StatsD is common wrapper for graphite metrics. This project enables the use of statsd metrics collection via spark metrics.properties file

Scala version 2.10.4 Build version 0.13.6 Spark version 1.5.2

###Steps to create assembly jar

git clone [email protected]:vidhyaarvind/spark-statsd.git

cd spark-statsd

sbt assembly

creates target/scala-2.10/spark-statsd-1.0.0.jar assembly jar file

Add settings to conf/metrics.properties

*.sink.statsd.class=org.apache.spark.metrics.sink.StatsDSink
*.sink.statsd.host=localhost
*.sink.statsd.port=8125

Run spark job

eg.

./bin/run-example SparkPi 10 --driver-class-path target/scala-2.10/spark-statsd-1.0.0.jar

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Scala 100.0%