Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka Connect: Add the configuration option to provide a transactional id prefix to use #11780

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

thjaeckle
Copy link

In a Kafka setup where strict ACLs are applied, e.g. based on a certain PREFIX for Transactional IDs, it is important to have the prefix configurable.

Currently, it is the name of the "Channel" (e.g. "worker" or "coordinator" for the 2 extending subclasses):

Channel(
String name,
String consumerGroupId,
IcebergSinkConfig config,
KafkaClientFactory clientFactory,
SinkTaskContext context) {
this.controlTopic = config.controlTopic();
this.connectGroupId = config.connectGroupId();
this.context = context;
String transactionalId = name + config.transactionalSuffix();

This PR introduces an optional prefix to add - which by default is empty so that the behaviour is not changed to the current behaviour.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant