Skip to content

Commit 8b03175

Browse files
committed
add comment
1 parent 03c3f42 commit 8b03175

File tree

1 file changed

+7
-1
lines changed

1 file changed

+7
-1
lines changed

demos/data-lakehouse-iceberg-trino-spark/create-spark-ingestion-job.yaml

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,13 @@ spec:
3333
- pipefail
3434
- -c
3535
- |
36-
# Configurable
36+
#!/usr/bin/bash
37+
#
38+
# Wait for Kafka topics created by the Nifi workflows to be ready.
39+
# Also wait for all topic partitions to have a leader.
40+
# This is required for the Spark streaming job to be able to read from the topics.
41+
# Without this check, the Spark job might hang indefinitely without processing any events.
42+
3743
BROKER="${BROKER:-kafka-broker-default-0-listener-broker:9093}"
3844
3945
log() {

0 commit comments

Comments
 (0)