v24.2.12

Bug Fixes

• Fixed an issue where creating a topic with a huge number of partitions could lead to a crash. by @IoannisRP in #24232

Improvements

• Schema Registry: Add Some metrics for resource usage taken by in-memory schemas by @BenPope in #24270

Full Changelog: v24.2.11...v24.2.12

v24.2.11

Bug Fixes

• Construct audit metrics probe during service initialization to prevent null pointer access. by @michael-redpanda in #24127
• Fixed an issue where creating a topic with a huge number of partitions could lead to a crash. by @IoannisRP in #24232
• Fixes a bug in which upload candidates made from segments with missing batches would trigger metadata related errors in the ntp_archiver_service, due to assigned start offsets being lower than they should be. by @WillemKauf in #24106
• #24076 Fixes a rare bug during remote partition manifest downloads where broken pipe exceptions weren't retried in an edge case. by @pgellert in #24080
• #24144 This fixes a bug in the audit client where if the cluster config value kafka_batch_max_bytes was greater than audit_client_max_buffer_size, the audit client ends up not producing any messages and becomes stuck filling up the audit log buffers. by @pgellert in #24148
• #24207 Redpanda neglected to include ECDSA based ciphers in the cipher strings used for TLSv1.2 and below. This caused TLS connections that used ECDSA based certificates to fail cipher negotiation when using TLSv1.2 and below. ECDSA ciphers are now in the list of supported ciphers. by @michael-redpanda in #24209

Full Changelog: v24.2.10...v24.2.11

v24.1.18

Features

• #23454 A new metric (cluster_features_enterprise_license_expiry_sec) is added for easier monitoring of the enterprise license's expiry time. by @pgellert in #23467
• #23760 Adds admin API endpoint for enterprise feature info GET /v1/features/enterprise by @oleiman in #23761

Bug Fixes

• Construct audit metrics probe during service initialization to prevent null pointer access. by @michael-redpanda in #24128
• Fixes a bug in which upload candidates made from segments with missing batches would trigger metadata related errors in the ntp_archiver_service, due to assigned start offsets being lower than they should be. by @WillemKauf in #24105
• Fixes a bug where only a group static member's protocols would be updated on rejoin, even if more properties had been passed to the rejoin command by @IoannisRP in #23733
• #23863 Fixes a bug where audit log manager would retry a bad request forever, causing buffers to fill up, blocking audit log appends and preventing authZ. by @oleiman in #23868
• #23930 Ignore heartbeat requests/replies to/from unexpected node ids. by @ztlpn in #23934
• #24056 Cleanup tiered storage temporary cache file if exceptions are thrown during download. by @nvartolomei in #24064
• #24077 Fixes a rare bug during remote partition manifest downloads where broken pipe exceptions weren't retried in an edge case. by @pgellert in #24079
• #24143 This fixes a bug in the audit client where if the cluster config value kafka_batch_max_bytes was greater than audit_client_max_buffer_size, the audit client ends up not producing any messages and becomes stuck filling up the audit log buffers. by @pgellert in #24149

Improvements

• --regex flag in rpk topic describe now supports internal topics. by @r-vasquez in #23605
• Adds a shard label to some consumer group metrics. by @ballard26 in #23626
• #23404 Adds the ability to configure Node UUID and ID overrides at broker startup. by @oleiman in #23412
• fixed large allocation in Raft implementation by @mmaslankaprv in #24009
• rpk: redpanda admin brokers list exposes Host/Port/Rack/UUID additionally by @daisukebe in #23688
• PR #23414 [v24.1.x] archival: use log_level_for_error() for failed reupload candidates by @WillemKauf
• PR #23450 [v24.1.x] storage: catch ss::gate_closed_exception in log_manager (manual backport) by @WillemKauf
• PR #23501 [v24.1.x] tests/failure_injector: undo the failures on exit by @bashtanov
• PR #23506 [v24.1.x] cluster_recovery_backend_test: only reset relevant config by @andrwng
• PR #23515 [v24.1.x] rptest: produce more data in FullDiskReclaimTest to trigger gc conditions by @nvartolomei
• PR #23527 [v24.1.x] CORE-7689 dt/rp_installer: ensure cache directory exists by @pgellert
• PR #23537 [v24.1.x] rptest: do not expect cached segment readers at the end of the test by @nvartolomei
• PR #23555 [v24.1.x] ssx: exit early from sleep_abortable if already aborted by @nvartolomei
• PR #23608 [v24.1.x] tests: fix rpk generate test by @r-vasquez
• PR #23646 [24.1.x] tests: bump ducktape to latest of 0.11.x by @ivotron
• PR #23674 [v24.1.x] tests: test legacy dashboard in rpk generate by @r-vasquez
• PR #23708 [v24.1.x] gha: rm use of rp_storage_tool_uploader by @andrewhsu
• PR #23746 [v24.1.x] Keep producer inflight requests queue bounded by @mmaslankaprv
• PR #23766 [v24.1.x] gha: fix pip install on python actions by @ivotron
• PR #23818 [v24.1.x] rpk: debug bundle collecting broker UUIDs by @daisukebe
• PR #23831 [v24.1.x] rpk: introduce license warnings messages by @r-vasquez
• PR #23849 [v24.1.x] [CORE-7957] tests: wait for license information comparisons by @r-vasquez
• PR #23861 [v24.1.x] kafka: oversized alloc in list_offsets_topic by @IoannisRP
• PR #23866 [v24.1.x] [CORE-7719] Add has_valid_license & has_enterprise_features to phone-home metrics by @oleiman
• PR #23923 [v24.1.x] rpk: fill schema registry information in cloud profiles by @r-vasquez
• PR #23965 [v24.1.x] [DEVEX-36] rpk: change expiry check for free_trial by @r-vasquez
• PR #23988 [v24.1.x] rpk: fix printing new lines by @r-vasquez
• PR #24015 [v24.1.x] metrics: Add list of enterprise features to call-home POST by @oleiman
• PR #24025 [v24.1.x] transform-sdk/go/tests: remove -quiet flag by @rockwotj
• PR #24044 [v24.1.x] [CORE-8141] Add host information to metrics report by @michael-redpanda
• PR #24051 [v24.1.x] storage: housekeeping metrics by @nvartolomei
• PR #24062 [v24.1.x] [CORE-1478] rptest: fix retention value in archive_retention_test by @WillemKauf
• PR #24070 [v24.1.x] rptest: reduce cache eviction throttling for space leak test by @nvartolomei
• PR #24089 [v24.1.x] storage: remove assertion on is_cloud_retention_active by @ballard26

Full Changelog: v24.1.17...v24.1.18

v24.2.10

Bug Fixes

• #24057 Cleanup tiered storage temporary cache file if exceptions are thrown during download. by @nvartolomei in #24063

Full Changelog: v24.2.9...v24.2.10

v24.2.9

Improvements

• Adds a shard label to some consumer group metrics. by @ballard26 in #23627
• fixed large allocation in Raft implementation by @mmaslankaprv in #24010
• PR #24012 [v24.2.x] metrics: Add list of enterprise features to call-home POST by @oleiman
• PR #24027 [v24.2.x] transform-sdk/go/tests: remove -quiet flag by @rockwotj
• PR #24045 [v24.2.x] [CORE-8141] Add host information to metrics report by @michael-redpanda
• PR #24048 [v24.2.x] storage: housekeeping metrics by @nvartolomei

Full Changelog: v24.2.8...v24.2.9

v24.2.8

Bug Fixes

• #23846 fixes the term of recovered topic moving backward by @mmaslankaprv in #23879
• #23864 Fixes a bug where audit log manager would retry a bad request forever, causing buffers to fill up, blocking audit log appends and preventing authZ. by @oleiman in #23867
• #23928 Ignore heartbeat requests/replies to/from unexpected node ids. by @ztlpn in #23933

Improvements

• rpk registry schema get will now fail if is incorrectly invoked using the --print-schema and --format flag. by @r-vasquez in #23901

Full Changelog: v24.2.7...v24.2.8

v24.2.7

Bug Fixes

• Fixes a bug where only a group static member's protocols would be updated on rejoin, even if more properties had been passed to the rejoin command by @IoannisRP in #23729
• Fixes possible high CPU utilisation caused by transactional coordinator leadership changes by @mmaslankaprv in #23617

Improvements

• rpk: --regex flag in rpk topic describe now supports internal topics. by @r-vasquez in #23604
• rpk: cluster license info now shows if your loaded license is expired by @r-vasquez in #23665
• rpk: redpanda admin brokers list exposes Host/Port/Rack/UUID additionally by @daisukebe in #23686

Full Changelog: v24.2.6...v24.2.7

v24.2.6

Features

• #23455 A new metric (cluster_features_enterprise_license_expiry_sec) is added for easier monitoring of the enterprise license's expiry time. by @pgellert in #23466
• rpk: supports triggering on-demand partition balancer by @daisukebe in #23216

Bug Fixes

• Fixes a bug where URL path params to PandaProxy and SchemaRegistry would be URL decoded twice, destroying escape sequences present in the original request. by @oleiman in #23547

Full Changelog: v24.2.5...v24.2.6

v23.3.21

Features

• #22957 Schema Registry: added support for the "verbose" query parameter on the schema compatibility checker endpoint by @pgellert in #23028

Bug Fixes

• Fixed a segfault that will occur if mTLS is in use and the auditing client is not configured correctly by @michael-redpanda in #23289
• Fixed possible oversized alloc in the DescribeLogsDir API handler by @michael-redpanda in #23292
• Fixes a bug that would cause retention to be applied to compact-only tiered storage topics. by @andrwng in #23361
• Fixes a regression in schema registry where concurrent requests could lead to memory faults by @oleiman in #23137
• Return NOT_COORDINATOR immediately in group transactional operations if the broker is aware that it is not the group coordinator. by @ztlpn in #23187
• #23108 Schema Registry: fixes a bug in the protobuf compatibility checks of nested fields where nested paths were incorrectly handled. by @pgellert in #23170
• #23222 Fixes a bug that resulted in persisting an invalid topic_properties configuration in the topic_table. by @WillemKauf in #23227

Improvements

• #23079 Schema Registry: Tolerate null metadata and ruleSet when registering or querying a schema by @BenPope in #23081
• #23108 Schema Registry: now reports more specific error messages for Avro and Protobuf schemas when they are incompatible with earlier schemas. by @pgellert in #23170
• PR #23238 [v23.3.x] config: mark cloud_storage_enabled() as needs_restart::yes by @WillemKauf

Full Changelog: v23.3.20...v23.3.21

v24.2.5

Features

• Adds admin API endpoint for enterprise feature info GET /v1/features/enterprise by @oleiman in #23368
• New REST API for mounting/unmounting topics by @bashtanov in #23209
• Schema Registry: verbose compatibility error reporting is now supported for JSON as well by @pgellert in #23299

Bug Fixes

• Fixed a segfault that will occur if mTLS is in use and the auditing client is not configured correctly by @michael-redpanda in #23288
• Fixed possible oversized alloc in the DescribeLogsDir API handler by @michael-redpanda in #23291
• Fixes a bug that resulted in persisting an invalid topic_properties configuration in the topic_table. by @WillemKauf in #23223
• Fixes a bug that would cause retention to be applied to compact-only tiered storage topics. by @andrwng in #23359
• Return NOT_COORDINATOR immediately in group transactional operations if the broker is aware that it is not the group coordinator. by @ztlpn in #23189
• #23316 Fixes crash when consuming from topic partitions with negative indexes by @bharathv in #23317

Improvements

• rpk connect now will be downloaded on the first run. by @r-vasquez in #23351
• rpk: introduce rpk connect install, rpk connect upgrade, and rpk connect uninstall, manual ways to manage rpk connect versioning. by @r-vasquez in #23351
• PR #23127 [v24.2.x] c/members_table: include members table version in the snapshot by @mmaslankaprv
• PR #23155 [v24.2.x] c/topic_config: Explicitly initialize non-class fields by @oleiman
• PR #23175 [v24.2.x] c/tm_stm: fix log format strings by @ztlpn
• PR #23236 [v24.2.x] config: mark cloud_storage_enabled() as needs_restart::yes by @WillemKauf
• PR #23241 [v24.2.x] Migrations storage improvements by @bashtanov
• PR #23242 [v24.2.x] cst/inv: Minor fixes for issues found during scrubber integration by @abhijat
• PR #23325 [v24.2.x] CORE-7268 fix migrated resources raft snapshot application by @bashtanov
• PR #23357 [v24.2.x] admin: add cloud_storage_cache_size check to config_multi_property_validation() by @WillemKauf

Full Changelog: v24.2.4...v24.2.5