Skip to content

Latest commit

 

History

History
62 lines (38 loc) · 3.28 KB

kafka-catalog.md

File metadata and controls

62 lines (38 loc) · 3.28 KB
title slug date keyword license
Kafka catalog
/kafka-catalog
2024-04-22
kafka catalog
This software is licensed under the Apache License version 2.

Introduction

Kafka catalog is a messaging catalog that offers the ability to manage Apache Kafka topics' metadata. One Kafka catalog corresponds to one Kafka cluster.

Catalog

Catalog properties

Besides the common catalog properties, the Kafka catalog has the following properties:

Property Name Description Default Value Required Since Version
bootstrap.servers The Kafka broker(s) to connect to, allowing for multiple brokers by comma-separating them. (none) Yes 0.5.0
gravitino.bypass. Property name with this prefix passed down to the underlying Kafka Admin client for use. (refer to Kafka Admin Configs for more details) (none) No 0.5.0

Catalog operations

Refer to Catalog operations for more details.

Schema

A "default" schema, which includes all the topics in the Kafka cluster, will be automatically created when catalog is created.

Schema capabilities

  • Since the "default" schema is read-only, it only supports loading and listing schema.

Schema properties

None.

Schema operations

Refer to Schema operation for more details.

Topic

Topic capabilities

  • The Kafka catalog supports creating, updating, deleting, and listing topics.

Topic properties

Property name Description Default value Required Since Version
partition-count The number of partitions for the topic. if not specified, will use the num.partition property in the broker. No 0.5.0
replication-factor The number of replications for the topic if not specified, will use the default.replication.factor property in the broker. No 0.5.0

You can pass other topic configurations to the topic properties. Refer to Topic Configs for more details.

Topic operations

Refer to Topic operation for more details.