Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump deltalake from 0.18.1 to 0.18.2 #154

Closed
wants to merge 1 commit into from

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Aug 12, 2024

Bumps deltalake from 0.18.1 to 0.18.2.

Release notes

Sourced from deltalake's releases.

python-v0.18.2: HDFS support

New features

Bug Fixes

Other Changes

New Contributors

Full Changelog: delta-io/delta-rs@python-v0.18.1...python-v0.18.2

Changelog

Sourced from deltalake's changelog.

rust-v0.18.2 (2024-08-07)

Full Changelog

Implemented enhancements:

  • Choose which columns to store min/max values for #2709
  • Projection pushdown for load_cdf #2681
  • Way to check if Delta table exists at specified path #2662
  • Support HDFS via hdfs-native package #2611
  • Deletion _change_type does not appear in change data feed #2579
  • Could you please explain in the README what "Deltalake" is for the uninitiated? #2523
  • Discuss: Allow protocol change during write actions #2444
  • Support for Arrow PyCapsule interface #2376

Fixed bugs:

  • Slow add_actions.to_pydict for tables with large number of columns, impacting read performance #2733
  • append is deleting records #2716
  • segmentation fault - Python 3.10 on Mac M3 #2706
  • Failure to delete dir and files #2703
  • DeltaTable.from_data_catalog not working #2699
  • Project should use the same version of ruff in the lint stage of python_build.yml as in pyproject.toml #2678
  • un-tracked columns are giving json error when pyarrow schema have feild with nullable=False and create_checkpoint is trigged #2675
  • [BUG]write_delta({'custom_metadata':str}) cannot be converted. str to pyDict error (0.18.2_DeltaPython/Windows10) #2697
  • Pyarrow engine not supporting schema overwrite with Append mode #2654
  • deltalake-core version re-exported by deltalake different than versions used by deltalake-azure and deltalake-gcp #2647
  • i32 limit in JSON stats #2646
  • Rust writer not encoding correct URL for partitions in delta table #2634
  • Large Types breaks merge predicate pruning #2632
  • Getting error when converting a partitioned parquet table to delta table #2626
  • Arrow: Parquet does not support writing empty structs when creating checkpoint #2622
  • InvalidTableLocation("Unknown scheme: gs") on 0.18.0 #2610
  • Unable to read delta table created using Uniform #2578
  • schema merging doesn't work when overwriting with a predicate #2567
  • Not working in AWS Lambda (0.16.2 - 0.17.4) OSError: Generic S3 error #2511
  • DataFusion filter on partition column doesn't work. (when the phsical schema ordering is different to logical one) #2494
  • Creating checkpoints for tables with missing column stats results in Err #2493
  • Cannot merge to a table with a timestamp column after upgrading delta-rs #2478
  • Azure AD Auth fails on ARM64 #2475
  • Generic S3 error: Error after 0 retries ... Broken pipe (os error 32) #2403
  • write_deltalake identifies large_string as datatype even though string is set in schema #2374
  • Inconsistent arrow timestamp type breaks datafusion query #2341

Closed issues:

  • Unable to write new partitions with type timestamp on tables created with delta-rs 0.10.0 #2631

Merged pull requests:

... (truncated)

Commits
  • aa28d73 chore: re-enable struct support update cdf
  • 73c354f refactor: use logical plan in update, remove sender, receiver logic CDF
  • 46460e2 feat: logical plan usage in delete
  • b8162c0 feat: use delta planner in delete and merge
  • c4c4022 feat: add delta planner
  • 98fa4cc feat: logical plan usage in delete
  • 624c73d refactor: delete cdc
  • 5219115 feat: cdc in writer
  • c552ada chore: fmt
  • 1555896 fix: schema adapter doesn't map partial batches correctly
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [deltalake](https://github.com/delta-io/delta.rs) from 0.18.1 to 0.18.2.
- [Release notes](https://github.com/delta-io/delta.rs/releases)
- [Changelog](https://github.com/delta-io/delta-rs/blob/main/CHANGELOG.md)
- [Commits](delta-io/delta-rs@rust-v0.18.1...rust-v0.18.2)

---
updated-dependencies:
- dependency-name: deltalake
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot added the dependencies Pull requests that update a dependency file label Aug 12, 2024
Copy link
Contributor Author

dependabot bot commented on behalf of github Aug 19, 2024

Superseded by #156.

@dependabot dependabot bot closed this Aug 19, 2024
@dependabot dependabot bot deleted the dependabot/cargo/deltalake-0.18.2 branch August 19, 2024 13:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants