Skip to content

patelliandrea/couchbase-kafka-connector

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

74 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Couchbase Kafka Connector

Porting of the official Couchbase Kafka connector. It is a Kafka Connector for loading data into Kafka from a Couchbase Bucket.

Development

To build a development version, you'll need the latest version of couchbase-jvm-core. You can build couchbase-kafka-connector with Maven using the standard lifecycle phases.

Configuration

Example of the configuration file:

# the name of the connector
name=couchbase-source
# the class of the Connector
connector.class=org.apache.kafka.connect.couchbase.CouchbaseSourceConnector
# topic on which produce the messages
topic=testcouchbase
# name of the schema to use for the produced messages
schema.name=testcouchbase
# addresses of the couchbase nodes, separated by ';'
couchbase.nodes=localhost
# bucket from which read documents to write on kafka
couchbase.bucket=beer-sample
# max number of tasks to run
tasks.max=1
# maximum number of documents to fetch from couchbase every second
dcp.maximum.drainrate=600
# size of the couchbase dcp buffer
couchbase.dcpConnectionBufferSize=0

About

A Couchbase to Kafka connector.

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages

  • HTML 90.3%
  • Java 7.8%
  • CSS 1.8%
  • JavaScript 0.1%