Skip to content

Releases: confluentinc/parallel-consumer

0.5.2.0

12 Jul 14:21
Compare
Choose a tag to compare

Fixes and Improvements

  • fixes #184: Fix multi topic subscription with KEY order by adding topic to shard key (#315)
  • fixes #329: Committing around transaction markers causes encoder to crash (#328)
  • build: Upgrade Truth-Generator to 0.1.1 for user Subject discovery (#332)

Build

  • build: Allow snapshots locally, fail in CI (#331)
  • build: OSS Index scan change to warn only and exclude Guava CVE-2020-8908 as it's WONT_FIX (#330)

Dependencies

  • build(deps): bump reactor-core from 3.4.19 to 3.4.21 (#344)
  • build(deps): dependabot bump Mockito, Surefire, Reactor, AssertJ, Release (#342) (#342)
  • build(deps): dependabot bump TestContainers, Vert.x, Enforcer, Versions, JUnit, Postgress (#336)

Linked issues

  • Message with null key lead to continuous failure when using KEY ordering #318
  • Subscribing to two or more topics with KEY ordering, results in messages of the same Key never being processed #184
  • Cannot have negative length BitSet error - committing transaction adjacent offsets #329

0.5.1.0

17 May 12:31
Compare
Choose a tag to compare

Features

  • #193: Pause / Resume PC (circuit breaker) without unsubscribing from topics

Fixes and Improvements

  • #225: Build and runtime support for Java 16+ (#289)
  • #306: Change Truth-Generator dependency from compile to test
  • #298: Improve PollAndProduce performance by first producing all records, and then waiting for the produce results.Previously, this was done for each ProduceRecord individually.

Raw

What's Changed

New Contributors

Full Changelog: 0.5.0.0...0.5.1.0

0.5.0.0

05 May 10:21
Compare
Choose a tag to compare

Features

  • feature: Poll Context object for API (#223)
    • PollContext API - provides central access to result set with various convenience methods as well as metadata about records, such as failure count
  • major: Batching feature and Event system improvements
    • Batching - all API methods now support batching.
      See the Options class set batch size for more information.

Fixes and Improvements

  • Event system - better CPU usage in control thread
  • Concurrency stability improvements
  • Update dependencies
  • #247: Adopt Truth-Generator (#249)
  • Large rewrite of internal architecture for improved maintence and simplicity which fixed some corner case issues
    • refactor: Rename PartitionMonitor to PartitionStateManager (#269)
    • refactor: Queue unification (#219)
    • refactor: Partition state tracking instead of search (#218)
    • refactor: Processing Shard object
  • fix: Concurrency and State improvements (#190)

Build

  • build: Lock TruthGenerator to 0.1 (#272)
  • build: Deploy SNAPSHOTS to maven central snaphots repo (#265)
  • build: Update Kafka to 3.1.0 (#229)
  • build: Crank up Enforcer rules and turn on ossindex audit
  • build: Fix logback dependency back to stable
  • build: Upgrade TestContainer and CP

Raw

What's Changed

  • build: Update Kafka to 3.1.0 by @astubbs in #229
  • build(deps): bump ossindex-maven-plugin from 3.1.0 to 3.2.0 by @dependabot in #244
  • build(deps): bump maven-dependency-plugin from 3.2.0 to 3.3.0 by @dependabot in #245
  • refactor: Partition state tracking instead of search by @astubbs in #218
  • build: Fix maven repetition by @astubbs in #251
  • #247: Adopt Truth-Generator by @astubbs in #249
  • build(deps): bump mycila.version from 4.2.rc2 to 4.2.rc3 by @dependabot in #253
  • build(deps): bump maven-clean-plugin from 3.1.0 to 3.2.0 by @dependabot in #257
  • build: Deploy SNAPSHOTS to maven central snaphots repo by @astubbs in #265
  • refactor: Queue unification by @astubbs in #219
  • refactor: Rename PartitionMonitor to PartitionStateManager by @astubbs in #269
  • build: Lock TruthGenerator to 0.1 by @astubbs in #272
  • build(deps): bump jacoco-maven-plugin from 0.8.7 to 0.8.8 by @dependabot in #256
  • build(deps): bump junit-pioneer from 1.6.2 to 1.7.0 by @dependabot in #260
  • build(deps-dev): bump podam from 7.2.8.RELEASE to 7.2.9.RELEASE by @dependabot in #261
  • build(deps): bump testcontainers.version from 1.16.3 to 1.17.0 by @dependabot in #263
  • build(deps): bump reactor-core from 3.4.16 to 3.4.17 by @dependabot in #274
  • build(deps-dev): bump postgresql from 42.3.3 to 42.3.4 by @dependabot in #277
  • build(deps): bump maven-javadoc-plugin from 3.3.2 to 3.4.0 by @dependabot in #276
  • build(deps): bump mockito.version from 4.4.0 to 4.5.1 by @dependabot in #278
  • build(deps): bump maven-site-plugin from 3.11.0 to 3.12.0 by @dependabot in #280
  • build(deps): bump testcontainers.version from 1.17.0 to 1.17.1 by @dependabot in #279
  • build(deps): bump nexus-staging-maven-plugin from 1.6.12 to 1.6.13 by @dependabot in #282
  • build(deps): bump maven-project-info-reports-plugin from 3.2.2 to 3.3.0 by @dependabot in #283
  • build(deps): bump vertx.version from 4.2.6 to 4.2.7 by @dependabot in #281
  • build(deps): bump lombok from 1.18.22 to 1.18.24 by @dependabot in #284
  • build(deps): bump wiremock from 2.32.0 to 2.33.2 by @dependabot in #285

Full Changelog: 0.4.0.1...0.5.0.0

0.4.0.1

28 Sep 14:25
Compare
Choose a tag to compare

Improvements

  • Add option to specify timeout for how long to wait offset commits in periodic-consumer-sync commit-mode
  • Add option to specify timeout for how long to wait for blocking Producer#send

Docs

  • docs: Confluent Cloud configuration links
  • docs: Add Confluent's product page for PC to README
  • docs: Add head of line blocking to README

0.4.0.0.

17 Sep 09:20
Compare
Choose a tag to compare

Features

  • feature: Generic Vert.x future support ie FileSystem, db etc..
  • feature: Vert.x concurrency control via WebClient host limits fixed - see #maxCurrency
  • feature: Project Reactor adapter module
  • refactor: Extract common base PC class - prevent module pollution

Fixes

  • fix: Allow any record to be attempted for reprocessing, not just retries
  • fix: BitSet encoder encodes too much data
  • Updated enforcer plugin configuration to exclude java 14
  • fix: Use ConcurrentSkipListMap instead of TreeMap to prevent concurrency issues under high pressure
  • log: Show record topic in slow-work warning message

0.3.2.0

23 Jul 17:20
Compare
Choose a tag to compare

Fixes and Improvements

  • Major: Upgrade to Apache Kafka 2.8 (still compatible with 2.6 and 2.7 though)
  • Adds support for managed executor service (Java EE Compatibility feature)
  • #65 support for custom retry delay providers

0.3.1.0

23 Jul 17:21
Compare
Choose a tag to compare

=== Fixes and Improvements

  • Major refactor to code base - primarily the two large God classes
    ** Partition state now tracked separately
    ** Code moved into packages
  • Busy spin in some cases fixed (lower CPU usage)
  • Reduce use of static data for test assertions - remaining identified for later removal
  • Various fixes for parallel testing stability

0.3.0.3

12 Jul 15:06
Compare
Choose a tag to compare

v0.3.0.3

Fixes and Improvements

Overview

  • Tests now run in parallel
  • License fixing / updating and code formatting
  • License format runs properly now when local, check on CI
  • Fix running on Windows and Linux
  • Fix JAVA_HOME issues

Details:

  • tests: Enable the fail fast feature now that it's merged upstream
  • tests: Turn on parallel test runs
  • format: Format license, fix placement
  • format: Apply Idea formatting (fix license layout)
  • format: Update mycila license-plugin
  • test: Disable redundant vert.x test - too complicated to fix for little gain
  • test: Fix thread counting test by closing PC @after
  • test: Test bug due to static state overrides when run as a suite
  • format: Apply license format and run every All Idea build
  • format: Organise imports
  • fix: Apply license format when in dev laptops - CI only checks
  • fix: javadoc command for various OS and envs when JAVA_HOME missing
  • fix: By default, correctly run time JVM as jvm.location

0.3.0.2

11 May 12:07
Compare
Choose a tag to compare

Fixes

  • fix: #101 Validate GroupId is configured on managed consumer
  • fix: #97 Vert.x thread and connection pools setup incorrect
  • fix: Set Serdes for MockProducer for AK 2.7 partition fix KAFKA-10503 to fix new NPE
  • Fixes #87 - Upgrade UniJ version for UnsupportedClassVersion error
  • Bump TestContainers to stable release to specifically fix #3574

Improvements

  • Only log slow message warnings periodically, once per sweep
  • Clean up stalled message warning logs
  • Reduce log-level if no results are returned from user-function (warn -> debug)
  • Upgrade Kafka container version to 6.0.2
  • Clarify offset management capabilities

CI

  • ci: Add CODEOWNER
  • ci: Bump jdk8 version path
  • ci: Apache Kafka and JDK build matrix
  • Disable Travis and Codecov
  • Use 8B1DA6120C2BF624 GPG Key For Signing
  • Enable java 8 Github

0.3.0.1

21 Jan 03:55
Compare
Choose a tag to compare

Fixes

  • #62: Off by one error when restoring offsets when no offsets are encoded in metadata