Skip to content

naveenmall11/kafka-connect-log-analytics

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

kafka-connect-log-analytics

Log analytics Sink Connector for Kafka-connect

  • this connector pull messages from Kafka topic and send to log analytics custom logs
  • Only supported message format is JSON with schema, make sure valid json is present in Kafka topic
  • Batch 100 records at a time for a given poll cycle
  • This derives log analytics columns based on the schema of the message received
  • Messages appear in log analytics under "Custom Logs" with "_CL" as post fix to given topic i.e. if "DATASINKLOGS" is source topic then messages will be displayed in log analytics under custom logs with name "DATASINKLOGS_CL"

Connector Definition

{
“name”:”sink-connector-1”
"connector.class": "io.kafka.connect.log.anlaytics.sink.LogAnlayticsSinkTask",
"tasks.max": "1",
"workspace.id":"xxxxx-xxxx-xxxx-xxxx-xxxxxxxx",
"workspace.key":"xxxxxxxxxx==",
"topics": "DATASINKLOGS"
}

About

Log Analytics Sink Connector

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 100.0%