Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

mongodb-source-connector #26

Open
sangeesivakumar opened this issue May 8, 2018 · 1 comment
Open

mongodb-source-connector #26

sangeesivakumar opened this issue May 8, 2018 · 1 comment

Comments

@sangeesivakumar
Copy link

my connections are opened but it is not flushing any records from the database
INFO Kafka version : 1.1.0-cp1 (org.apache.kafka.common.utils.AppInfoParser:109)
[2018-05-08 17:10:24,265] INFO Kafka commitId : 93e03414f72c2485 (org.apache.kafka.common.utils.AppInfoParser:110)
[2018-05-08 17:10:24,281] INFO Created connector mongodb-source-connector-thirteen (org.apache.kafka.connect.cli.ConnectStandalone:104)
[2018-05-08 17:10:24,422] INFO Cluster created with settings {hosts=[127.0.0.1:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500} (org.mongodb.driver.cluster:71)
[2018-05-08 17:10:24,445] INFO Cluster description not yet available. Waiting for 30000 ms before timing out (org.mongodb.driver.cluster:71)
[2018-05-08 17:10:24,664] INFO Opened connection [connectionId{localValue:1, serverValue:6}] to 127.0.0.1:27017 (org.mongodb.driver.connection:71)
[2018-05-08 17:10:24,665] INFO Monitor thread successfully connected to server with description ServerDescription{address=127.0.0.1:27017, type=STANDALONE, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 4]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, roundTripTimeNanos=550564} (org.mongodb.driver.cluster:71)
[2018-05-08 17:10:24,678] INFO Cluster created with settings {hosts=[127.0.0.1:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500} (org.mongodb.driver.cluster:71)
[2018-05-08 17:10:24,684] INFO Cluster description not yet available. Waiting for 30000 ms before timing out (org.mongodb.driver.cluster:71)
[2018-05-08 17:10:24,691] INFO Opened connection [connectionId{localValue:2, serverValue:7}] to 127.0.0.1:27017 (org.mongodb.driver.connection:71)
[2018-05-08 17:10:24,694] INFO Monitor thread successfully connected to server with description ServerDescription{address=127.0.0.1:27017, type=STANDALONE, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 4]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, roundTripTimeNanos=1392005} (org.mongodb.driver.cluster:71)
[2018-05-08 17:10:24,699] INFO WorkerSourceTask{id=mongodb-source-connector-thirteen-0} Source task finished initialization and start (org.apache.kafka.connect.runtime.WorkerSourceTask:165)
[2018-05-08 17:10:24,739] INFO Opened connection [connectionId{localValue:4, serverValue:8}] to 127.0.0.1:27017 (org.mongodb.driver.connection:71)
[2018-05-08 17:10:24,754] INFO Opened connection [connectionId{localValue:3, serverValue:9}] to 127.0.0.1:27017 (org.mongodb.driver.connection:71)
[2018-05-08 17:11:24,281] INFO WorkerSourceTask{id=mongodb-source-connector-thirteen-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:328)
[2018-05-08 17:11:24,282] INFO WorkerSourceTask{id=mongodb-source-connector-thirteen-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:345)
[2018-05-08 17:12:24,283] INFO WorkerSourceTask{id=mongodb-source-connector-thirteen-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:328)
[2018-05-08 17:12:24,283] INFO WorkerSourceTask{id=mongodb-source-connector-thirteen-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:345)

my property file

name=mongodb-source-connector-fifteen
connector.class=org.apache.kafka.connect.mongodb.MongodbSourceConnector
tasks.max=1
uri=mongodb://127.0.0.1:27017
host=127.0.0.1
port=27017
batch.size=100
schema.name=mongodbschema
topic.prefix=mongodb-kafka
converter.class=org.apache.kafka.connect.mongodb.converter.JsonStructConverter
databases=volumata.demography,volumata.mycollection

@sangeesivakumar
Copy link
Author

@patelliandrea can you please help me to sort out this issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant