Sign inSign up

zendesk/maxwell

By zendesk

•Updated 9 days ago

Maxwell's daemon, a mysql-to-json kafka producer http://maxwells-daemon.io

Image
23

10M+

zendesk/maxwell repository overview

This is Maxwell's daemon, a change data capture⁠ application that reads MySQL binlogs and writes data changes as JSON to Kafka, Kinesis, and other streaming platforms.

↓ Download⁠ | ⚝ Source / Community⁠ | ☝ Getting Started⁠ | ☷ Reference⁠

What's it for?

  • ETL of all sorts
  • maintaining an audit log of all changes to your database
  • cache building/expiring
  • search indexing
  • inter-service communication

It goes like this:

  mysql> update `test`.`maxwell` set mycol = 55, daemon = 'Stanislaw Lem';
  maxwell -> kafka: 
  {
    "database": "test",
    "table": "maxwell",
    "type": "update",
    "ts": 1449786310,
    "data": { "id":1, "daemon": "Stanislaw Lem", "mycol": 55 },
    "old": { "mycol":, 23, "daemon": "what once was" }
  }

Tag summary

Content type

Image

Digest

sha256:89acddd2f…

Size

497 MB

Last updated

9 days ago

docker pull zendesk/maxwell