Support for Confluent Schema Registry?

[DaveSlinn]

We are using https://github.com/takebayashi/fluent-plugin-avro to format our messages as Avro, but when sending to our kafka cluster, we need to prefix the avro data with 5 bytes to conform with the Confluent Schema Registry, as described here:

https://docs.confluent.io/current/schema-registry/serializer-formatter.html#wire-format

Is this possible? Is there a buffer or filter plugin that allows us to modify the raw bytes sent to Kafka after it has been formatted but before it is sent?

[rverma-jm]

@DaveSlinn did you find any solution for your usecase?

[DaveSlinn]

Yes, a co-worker of mine forked the Avro plugin and added the ability to specify the confluent schema id. His forked repo is here: https://github.com/mstinglin/fluent-plugin-avro. We've been using it for months now. Works great.

[github-actions]

This issue has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this issue will be closed in 30 days