Skip to content
/ maxwell Public
forked from zendesk/maxwell

🔨😈 Maxwell's daemon, a mysql-to-json kafka producer

License

Notifications You must be signed in to change notification settings

vend/maxwell

 
 

Repository files navigation

This is Maxwell's daemon, a change data capture application that reads MySQL binlogs and writes data changes as JSON to Kafka, Kinesis, and other streaming platforms.

↓ Download | ⚝ Source / Community | ☝ Getting Started | ☷ Reference

What's it for?

  • ETL of all sorts
  • maintaining an audit log of all changes to your database
  • cache building/expiring
  • search indexing
  • inter-service communication

It goes like this:

  mysql> update `test`.`maxwell` set mycol = 55, daemon = 'Stanislaw Lem';
  maxwell -> kafka: 
  {
    "database": "test",
    "table": "maxwell",
    "type": "insert",
    "ts": 1449786310,
    "data": { "id":1, "daemon": "Stanislaw Lem", "mycol": 55 },
    "old": { "mycol":, 23, "daemon": "what once was" }
  }

About

🔨😈 Maxwell's daemon, a mysql-to-json kafka producer

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Java 94.7%
  • ANTLR 2.9%
  • Shell 1.0%
  • Ruby 0.8%
  • JavaScript 0.4%
  • Dockerfile 0.1%
  • Makefile 0.1%