We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 03c3f42 commit 8b03175Copy full SHA for 8b03175
demos/data-lakehouse-iceberg-trino-spark/create-spark-ingestion-job.yaml
@@ -33,7 +33,13 @@ spec:
33
- pipefail
34
- -c
35
- |
36
- # Configurable
+ #!/usr/bin/bash
37
+ #
38
+ # Wait for Kafka topics created by the Nifi workflows to be ready.
39
+ # Also wait for all topic partitions to have a leader.
40
+ # This is required for the Spark streaming job to be able to read from the topics.
41
+ # Without this check, the Spark job might hang indefinitely without processing any events.
42
+
43
BROKER="${BROKER:-kafka-broker-default-0-listener-broker:9093}"
44
45
log() {
0 commit comments