Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump deltalake from 0.18.1 to 0.19.0 #156

Merged
merged 1 commit into from
Aug 30, 2024

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Aug 19, 2024

Bumps deltalake from 0.18.1 to 0.19.0.

Release notes

Sourced from deltalake's releases.

python-v0.19.0: complete CDF support, add column operation, faster MERGE

Breaking changes!

Default writer engine has changed to rust. Replace your partition_filters with a predicate (sql) instead. PyArrow engine is deprecated now, and will be removed in v1.0.

Highlights

  • CDF support in write_deltalake, delete, and merge operation
  • Expired logs cleanup during post-commit. Can be disabled with delta.enableExpiredLogCleanup = false
  • Improved MERGE performance by using predicate non-partition columns min/max for prefiltering
  • ADD column operation
  • Speed up log parsing

Performance improvements

New features

Bug Fixes

... (truncated)

Changelog

Sourced from deltalake's changelog.

rust-v0.19.0 (2024-08-14)

Full Changelog

Implemented enhancements:

  • Only allow squash merge #2542

Fixed bugs:

  • Write also insert change types in writer CDC #2750
  • Regression in Python multiprocessing support #2744
  • SchemaError occurs during table optimisation after upgrade to v0.18.1 #2731
  • AWS WebIdentityToken exposure in log files #2719
  • Write performance degrades with multiple writers #2683
  • Write monotonic sequence, but read is non monotonic #2659
  • Python write_deltalake with schema_mode="merge" casts types #2642
  • Newest docs (potentially) not released #2587
  • CDC is not generated for Structs and Lists #2568

Closed issues:

Merged pull requests:

rust-v0.18.2 (2024-08-07)

Full Changelog

Implemented enhancements:

... (truncated)

Commits
  • d3a7967 fix: allow missing file stats in log replay
  • 0d1c899 feat: use kernel expression evaluator
  • 60e52b6 feat: read PruningStatistics from files batch
  • a174449 feat: parse partition values during log replay
  • 1d2f758 test: geneate test add actions with partition values
  • 3b9847a :test: add stats parsing test
  • eb32a87 chore: fix a bunch of clippy lints and re-enable tests
  • 29db286 fix: column parsing to include nested columns and enclosing to adopt 0.18.x
  • c446b12 chore: prepare the next notable release of 0.19.0
  • 51c8203 chore: remove features which cause issues
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot dependabot bot added the dependencies Pull requests that update a dependency file label Aug 19, 2024
@dependabot dependabot bot force-pushed the dependabot/cargo/deltalake-0.19.0 branch from 8414102 to 2029272 Compare August 30, 2024 16:46
Bumps [deltalake](https://github.com/delta-io/delta.rs) from 0.18.1 to 0.19.0.
- [Release notes](https://github.com/delta-io/delta.rs/releases)
- [Changelog](https://github.com/delta-io/delta-rs/blob/main/CHANGELOG.md)
- [Commits](delta-io/delta-rs@rust-v0.18.1...rust-v0.19.0)

---
updated-dependencies:
- dependency-name: deltalake
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot force-pushed the dependabot/cargo/deltalake-0.19.0 branch from 2029272 to fded21c Compare August 30, 2024 16:56
@skariyania skariyania enabled auto-merge (squash) August 30, 2024 16:59
@skariyania skariyania merged commit 737261a into main Aug 30, 2024
5 checks passed
@skariyania skariyania deleted the dependabot/cargo/deltalake-0.19.0 branch August 30, 2024 17:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant