Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add configuration to exclude topic on file path #1172

Merged
merged 2 commits into from
Jan 10, 2025

Conversation

shibd
Copy link
Member

@shibd shibd commented Jan 9, 2025

Motivation

Sometimes users want all multi-topics file send to a unified pathPrefix without topic name.

For examples:

  • topic 1: pathPrefix/24.14.23.json
  • topic 2: pathPrefix/24.14.23.json

Modifications

  • Add configuration(partitionerWithTopicName) to exclude topic on file path

Verifying this change

  • Add unit test to cover this.

Documentation

Check the box below.

Need to update docs?

  • doc-required

    (If you need help on updating docs, create a doc issue)

  • no-need-doc

    (Please explain why)

  • doc

    (If this PR contains doc changes)

@shibd shibd requested a review from a team as a code owner January 9, 2025 13:40
@github-actions github-actions bot added the doc This pr contains a document label Jan 9, 2025
@shibd shibd merged commit d0450e2 into streamnative:master Jan 10, 2025
1 check passed
shibd added a commit to shibd/pulsar-io-cloud-storage that referenced this pull request Jan 10, 2025
* Add configuration to exclude topic on file path

* add docs

(cherry picked from commit d0450e2)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
doc This pr contains a document
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants