Pinned Loading

1. flan flan Public

   Create (very good) fake NCSA Combined Log Format access.log files for testing log-consuming systems like Splunk, ActiveMQ, Amazon MQ, RabbitMQ, Kafka, FluentD, Flume, Pulsar, Nifi...

   Python 4 1

2. snakrAWS snakrAWS Public

   Custom short URL generator and analytics port from Google Compute Engine/Python 2 to AWS/EC2/Postgres RDS/Python 3. Post on social media and get the same view-to-click analytics as paid/commercial …

   Python 1

3. sherlock sherlock Public

   Forked from yahoo/sherlock

   Sherlock is an anomaly detection service built on top of Druid

   Java

4. Hadoop + Spark installation (OSX) Hadoop + Spark installation (OSX)

   1

   Source: http://datahugger.org/datascience/setting-up-hadoop-v2-with-spark-v1-on-osx-using-homebrew/

   2

   3

   This post builds on the previous setup Hadoop (v1) guide, to explain how to setup a single node Hadoop (v2) cluster with Spark (v1) on OSX (10.9.5).

   4

   5

   Apache Hadoop is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures. The Apache Hadoop framework is composed of the following core modules:

5. dr-elephant-mapr dr-elephant-mapr Public

   MapR compatible fork of Dr Elephant 2.0.6 (NOT MAINTAINED)

   Java 2