Home

Welcome to the ashash wiki!

Working with Kafka, from Talha:

Okay so I am working with kafka 2.1.0, you can download kafka here if you don't already have it: (https://kafka.apache.org/downloads#2.1.0). After getting kafka, do the following steps:

1. cd into your kafka folder. For example mine is /Users/Talha/repos/iij/kafkaScripts/kafka_2.11-2.1.0/
2. Go to config/server.properties and change log.retention.hours to equal -1. (This is so that records with old timestamps don't disappear).
3. Set up zoo keeper instance: bin/zookeeper-server-start.sh config/zookeeper.properties
4. Set up kafka broker instance: bin/kafka-server-start.sh config/server.properties
5. Run this file to push data for route-views.wide to the Kafka server: https://github.com/InternetHealthReport/kafka-producer-bgp/blob/master/simpleProducer.py (If you can, please note how long this takes)
6. Pull updated code from kafkaLinkage branch in the ashash repo.
7. cd to ashash dir and run: python2 src/ashash.py -c route-views.wide -o ./wideTest/ 2017-11-06T16:00 2017-11-06T22:00 (Please note how long this step takes)
8. Run this step just to make sure the graph output is correct at your end: 8python2 src/analysis/plotLocalHegemony.py -i ./wideTest/ -a 33667* (edited)