Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix] [bk] Add configuration parameters related to the maximum compaction duration to the bookkeeper.conf #23819

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

sandeep-mst
Copy link

@sandeep-mst sandeep-mst commented Jan 7, 2025

Fixes #23818

Motivation

bookkeeper.conf is missing parameters related to maximum compaction duration in apache/pulsar. These parameters are useful for managing bookkeeper compaction in heavy workloads.

Modifications

Added majorCompactionMaxTimeMillis and minorCompactionMaxTimeMillis to conf/bookkeeper.conf so that they can be updated from env variables in pulsar docker containers using apply-config-from-env.py script.

Verifying this change

  • Make sure that the change passes the CI checks.

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

Does this pull request potentially affect one of the following parts:

If the box was checked, please highlight the changes

  • Dependencies (add or upgrade a dependency)
  • The public API
  • The schema
  • The default values of configurations
  • The threading model
  • The binary protocol
  • The REST endpoints
  • The admin CLI options
  • The metrics
  • Anything that affects deployment

Documentation

  • doc
  • doc-required
  • doc-not-needed
  • doc-complete

Matching PR in forked repository

PR in forked repository:
cognitree#18

@github-actions github-actions bot added the doc-not-needed Your PR changes do not impact docs label Jan 7, 2025
@lhotari
Copy link
Member

lhotari commented Jan 7, 2025

Added majorCompactionMaxTimeMillis and minorCompactionMaxTimeMillis to conf/bookkeeper.conf so that they can be updated from env variables in pulsar docker containers using apply-config-from-env.py script.

The workaround is to use PULSAR_PREFIX_ for the environment variables.

@sandeep-mst
Copy link
Author

Added majorCompactionMaxTimeMillis and minorCompactionMaxTimeMillis to conf/bookkeeper.conf so that they can be updated from env variables in pulsar docker containers using apply-config-from-env.py script.

The workaround is to use PULSAR_PREFIX_ for the environment variables.

Thanks for the workaround. It is still useful to have these parameters in the bookkeeper.conf.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
doc-not-needed Your PR changes do not impact docs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug] Missing Configuration in bookkeeper.conf
2 participants