#545 Add the ability to manage partitioning schemes for Delta Lake format #546

yruslan · 2025-02-06T11:40:00Z

Closes #545

…ition strategies.

…ng variation.

…sted fields.

…olumn with 'yyyy-MM' dates.

github-actions · 2025-02-06T11:51:48Z

Overall Project	84.51% `-0.03%`	🍏
Files changed	93.53%	🍏

Module	Coverage
pramen:core Jacoco Report	85.37% `-0.04%`	🍏

Files

Module	File	Coverage
pramen:core Jacoco Report	MetaTable.scala	98.96%	🍏
	TransferTableParser.scala	97.6%	🍏
	InfoDateConfig.scala	96.92% `-1.29%`	❌
	MetastorePersistenceDelta.scala	86.12% `-1.84%`	🍏
	MetastorePersistence.scala	84.62%	🍏

yruslan added 6 commits January 30, 2025 11:25

#545 Change the metastore configuration model to include various part…

48ad89e

…ition strategies.

#545 Implement new configuration options for the metastore partitioni…

eabad10

…ng variation.

#545 Implement new partitioning options with monthly partitions be ne…

906588e

…sted fields.

#545 Add another partitioning schema, the one that creates a single c…

2764cef

…olumn with 'yyyy-MM' dates.

#545 Update README with partitioning possibilities of metastore tables.

bcc543c

#545 Add tests for partitioning schemes of Delta tables.

9ca827f

#545 Remove redundant println() statements in tests.

534ce62

yruslan merged commit 4144c89 into main Feb 6, 2025
8 checks passed

yruslan deleted the feature/545-delta-generated-pertitioning branch February 6, 2025 12:22

Provide feedback