partition-manager v0.4.1

This is a point release that fixes two minor issues.

What's Changed

• Add NoValidRatesOfChangeException and don't emit ALTER errors for it by @jcjones in #87
• Add sha256sums to the releases by @jcjones in #88

Full Changelog: v0.4.0...v0.4.1

partition-manager checksums

Commits

• ec32378: sha256sums (J.C. Jones)

partition-manager v0.4.0

Partition Manager v0.4.0 adds a drop command that produces ALTER TABLE ... DROP PARTITION IF EXISTS ... statements ready for execution, obeying a retention policy set in the configuration file.

The policy is set per table as such:

partitionmanager:
  tables:
    certificates:
      retention_period:
        days: 90

Or can be set globally as:

partitionmanager:
  partition_period:
    days: 30

If both are set, the table-level policy supersedes.

Behavior Changes

• Prometheus statistics are no longer are emitted for tables not in the configuration file
• Empty tables no longer are marked as ALTER errors in Prometheus statistics

Packaging

This release of Partition Manager is only released as a source tarball or a Python wheel file. .deb files are no longer packaged in this project.

What's Changed

• Prevent potential supply chain attack by referencing a commit rather than @latest in GH action by @pgporada in #65
• Retention-based Partition Dropping by @jcjones in #44
• Fix typos discovered by codespell by @cclauss in #71
• pre-commit autoupdate && pre-commit run --all-files by @cclauss in #69
• Keep GitHub Actions up to date with GitHub's Dependabot by @cclauss in #74
• Replace black and flake8 with ruff by @cclauss in #75
• Switch to pyproject.toml from setup.py by @jcjones in #73
• Bump the github-actions group with 3 updates by @dependabot in #76
• Ruff format --line-length=88 by @cclauss in #82
• Don't emit a Prometheus error for empty tables by @jcjones in #80
• Use timezone-aware datetimes -- ruff check --select=DTZ by @cclauss in #84
• Use comprehensions -- ruff check --select=C4 by @cclauss in #83
• Don't emit metrics for tables not in the config file by @jcjones in #78
• Refactor do_partition to reduce the statement count by @jcjones in #81

New Contributors

• @cclauss made their first contribution in #71
• @dependabot made their first contribution in #76

Future Notes

Partition Manager v1.0.0 will stop using partition names to determine partition ages, instead requiring every monitored table to provide a SQL query to resolve partition boundaries. This will break configurations that do not set earliest_utc_timestamp_query for each table.

Partition Manager then will stop keeping names up-to-date, and switch to using partition names that don't attempt to convey temporal meaning.

This is going to simplify a lot of the Partition Manager code, which all assumes that the partition names must be cared for as metadata.

Full Changelog: v0.3.6...v0.4.0

partition-manager github-actions-62246740de

Commits

• 84a3a17: Bump the github-actions group with 3 updates (dependabot[bot]) #76
• c5978f1: Merge branch 'main' into dependabot/github_actions/github-actions-62246740de (J.C. Jones) #76
• fd9e309: Add workflow_dispatch (J.C. Jones) #76

partition-manager v0.3.6

Fixes a bug in multi-column tables. See #60

What's Changed

• Correct multi-column key partition ordering by @jcjones in #61

Full Changelog: v0.3.5...v0.3.6

partition-manager v0.3.5

What's Changed

• It'd help to debug command execution failures if we had the query! by @jcjones in #58
• Increase alter wait from 2 seconds to 6 by @lenaunderwood22 in #59

New Contributors

• @lenaunderwood22 made their first contribution in #59

Full Changelog: v0.3.4...v0.3.5

partition-manager v0.3.4

Set WAIT 2 for all ALTER TABLE REORGANIZE PARTITION calls (#57)

* Set WAIT 2 for all ALTER TABLE REORGANIZE PARTITION calls

* Ensure alter_time_seconds gets updated even on nonzero SQL exits. Thanks @mcpherrinm

* Add a metric for alter_errors and reorder logs to be clearer on large tables

partition-manager v0.3.3

Don't fail completely if we throw on a table. (#56)

partition-manager v0.3.2

Build scripts must call python3, not python

partition-manager v0.3.1

Don't divide by zero (#53)

Fix #39

This mostly just improves the logging. This can still happen if the partitions
have out-of-order numbers, which is going to be handled more in #51