Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate kafka-operator to use listener-operator for exposing brokers #443

Merged
merged 51 commits into from
Oct 7, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
51 commits
Select commit Hold shift + click to select a range
6c9c18f
Migrate kafka-operator to use lb-operator for exposing brokers
nightkr Aug 4, 2022
ae8ed3a
regenerated charts
maltesander Aug 29, 2022
f57097b
Update for lb-operator -> listener-operator rebrand
nightkr Sep 8, 2022
d963287
Merge branch 'spike/lb-operator' of github.com:stackabletech/kafka-op…
nightkr Sep 8, 2022
1f5a4e5
Merge branch 'main' into spike/lb-operator
siegfriedweber Oct 18, 2022
9c4b0b3
Merge branch 'main' into spike/lb-operator
siegfriedweber Oct 25, 2022
3a72373
Use ListenerOperatorVolumeSourceBuilder
siegfriedweber Oct 25, 2022
f35b23b
Use shortcut for creating the listener volume
siegfriedweber Oct 26, 2022
0b70333
Allow git source for operator-rs temporarily
siegfriedweber Oct 26, 2022
1d5749e
Merge remote-tracking branch 'origin/main' into spike/lb-operator
sbernauer Mar 1, 2023
e9d768a
Rename node_cmd -> node_address_cmd
sbernauer Mar 1, 2023
006b122
Remove operator-rs entry in deny.toml
sbernauer Mar 1, 2023
6d84c59
Merge remote-tracking branch 'origin/main' into spike/lb-operator
sbernauer Apr 25, 2023
df70f88
Merge branch 'main' into spike/lb-operator
nightkr Sep 12, 2023
6d47407
Merge branch 'main' into spike/lb-operator
nightkr Sep 4, 2024
3167720
Make listenerclass configurable
nightkr Sep 5, 2024
f357a06
Use operator-rs from git
nightkr Sep 5, 2024
f93d9ab
Use listener secret scope
nightkr Sep 6, 2024
cab56ff
Use listener for bootstrap and discovery
nightkr Sep 6, 2024
acb686e
Separate out kcat secret management now that it is the only PEM user
nightkr Sep 9, 2024
c91a041
Remove unused KafkaTlsSecurity::kafka
nightkr Sep 9, 2024
d960573
Regenerate CRD
nightkr Sep 9, 2024
25cca0e
Switch to main op-rs
nightkr Sep 9, 2024
c3018bc
Switch to per-rolegroup bootstrap listeners
nightkr Sep 11, 2024
bc44888
make crds
nightkr Sep 11, 2024
26d5922
CRD docs
nightkr Sep 11, 2024
f1b6c62
Delete old test files
nightkr Sep 11, 2024
a79b91a
Documentation
nightkr Sep 11, 2024
ad3fd98
Try to un-angry rustdoc
nightkr Sep 11, 2024
b62edf6
Re-enable orphan cleanup
nightkr Sep 11, 2024
a6343d4
Changelog
nightkr Sep 11, 2024
6a1a423
Fix configuration test
nightkr Sep 11, 2024
194d98d
Update docs/modules/kafka/examples/getting_started/kafka.yaml
nightkr Oct 1, 2024
b01c22f
Rename TLS volume variables for consistency
nightkr Oct 1, 2024
220bc4c
Rename volumes/paths too, correspondingly
nightkr Oct 1, 2024
2da65c6
Merge branch 'spike/lb-operator' of github.com:stackabletech/kafka-op…
nightkr Oct 1, 2024
df56f73
Remove stale FIXME
nightkr Oct 1, 2024
66db99c
Add RBAC permission to delete listeners (orphan clenaup)
nightkr Oct 1, 2024
362dc80
Make service_ports return ListenerPorts instead
nightkr Oct 1, 2024
fa9b8e2
Recommend using the same ListenerClass across rolegroups
nightkr Oct 1, 2024
88dde6b
Apply recommended labels to broker listeners
nightkr Oct 2, 2024
7aa5919
Apply the correct rolegroup to bootstrap listeners, too
nightkr Oct 2, 2024
534d88e
Apply the correct rolegroup label to the rolegroup configmaps
nightkr Oct 2, 2024
7dae34d
Apply recommended labels to the bootstrap listener PVC too
nightkr Oct 2, 2024
853d5f1
Merge branch 'main' into spike/lb-operator
nightkr Oct 2, 2024
2913081
Remove version from persistent PVCs
nightkr Oct 3, 2024
11a4814
Add note about upgrading to changelog
nightkr Oct 4, 2024
6e2d0d3
docs: Add note on what bootstrap listeners return
sbernauer Oct 7, 2024
c1c8c9f
Update futures to 0.3.31
nightkr Oct 7, 2024
f58c534
Drop unused futures compat feature
nightkr Oct 7, 2024
17e96e1
Reformat bootstrap rolegroup note slightly
nightkr Oct 7, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,10 @@ All notable changes to this project will be documented in this file.
- Reduce CRD size from `479KB` to `53KB` by accepting arbitrary YAML input instead of the underlying schema for the following fields ([#750]):
- `podOverrides`
- `affinity`
- Migrate to exposing Kafka using Listener Operator ([#443]).
sbernauer marked this conversation as resolved.
Show resolved Hide resolved
- BREAKING: The existing services will be migrated to the new format. Clients will need to re-read settings from the discovery configmap.
- BREAKING: Kafka is now only accessible from within the Kubernetes cluster by default. Set listener classes manually to expose it to the outside world (again).
- BREAKING: To complete an upgrade to this kafka-operator, all existing Kafka StatefulSets must be deleted manually. This will cause some downtime.

### Fixed

Expand All @@ -24,6 +28,7 @@ All notable changes to this project will be documented in this file.

- Remove versions `3.4.1`, `3.6.1`, `3.6.2` ([#753]).

[#443]: https://github.com/stackabletech/kafka-operator/pull/443
[#741]: https://github.com/stackabletech/kafka-operator/pull/741
[#750]: https://github.com/stackabletech/kafka-operator/pull/750
[#753]: https://github.com/stackabletech/kafka-operator/pull/753
Expand Down
53 changes: 23 additions & 30 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading