v9.0.0

v9.0.0

Breaking

• remove possibility to inject auth credentials via url string, because of the risk leaking credentials in logs
  • if you want to use basic auth, then you have to set the environment variables
    • :code:LOGPREP_CONFIG_AUTH_USERNAME=<your_username>
    • :code:LOGPREP_CONFIG_AUTH_PASSWORD=<your_password>
  • if you want to use oauth, then you have to set the environment variables
    • :code:LOGPREP_CONFIG_AUTH_TOKEN=<your_token>
    • :code:LOGPREP_CONFIG_AUTH_METHOD=oauth

Features

Improvements

• improve error message on empty rule filter
• reimplemented pseudonymizer processor
  • rewrote tests till 100% coverage
  • cleaned up code
  • reimplemented caching using pythons lru_cache
  • add cache metrics
  • removed max_caching_days config option
  • add max_cached_pseudonymized_urls config option which defaults to 1000
  • add lru caching for peudonymizatin of urls
• improve loading times for the rule tree by optimizing the rule segmentation and sorting
• add support for python 3.12 and remove support for python 3.9
• always check the existence of a field for negated key-value based lucene filter expressions

Bugfix

• fix the rule tree parsing some rules incorrectly, potentially resulting in more matches
• fix confluent_kafka commit issue after kafka did some rebalancing, fixes also negative offsets

Details

• Update publish-release-to-pypi.yml to use trusted publishing by @dtrai2 in #474
• Improve error message on empty rule filter by @dtrai2 in #471
• refactor pseudonymizer by @ekneg54 in #466
• remove url string credential injection by @ekneg54 in #465
• fix changelog by @ekneg54 in #479
• add support python 3.12 and drop support python 3.9 by @ekneg54 in #447
• Improve rule loading times in rule tree by @ppcad in #464
• always expect exists filter by @ppcad in #480
• Fix kafka commit after rebalancing issue by @dtrai2 in #486
• prepare release 9.0.0 by @ekneg54 in #488
• fix release pipeline by @ekneg54 in #489

Full Changelog: v8.0.0...v9.0.0