Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

enable delta partitioning on arrow normalizer load id #2022

Merged
merged 3 commits into from
Nov 4, 2024
Merged

enable delta partitioning on arrow normalizer load id #2022

merged 3 commits into from
Nov 4, 2024

Conversation

jorritsandbrink
Copy link
Collaborator

  • adds logic to handle bug in delta-rs
  • enables partitioning on load id column added by Arrow normalizer when using delta table format

@netlify Netlify
Copy link

netlify bot commented Nov 4, 2024 •
edited
Loading

✅ Deploy Preview for dlt-hub-docs canceled.

Name Link
🔨 Latest commit 73a8f8e
🔍 Latest deploy log https://app.netlify.com/sites/dlt-hub-docs/deploys/6728b349a057890008bbf2f1

rudolfix
rudolfix previously approved these changes Nov 4, 2024
View reviewed changes
Copy link
Collaborator

@rudolfix rudolfix left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@jorritsandbrink jorritsandbrink marked this pull request as ready for review November 4, 2024 14:25
rudolfix
rudolfix approved these changes Nov 4, 2024
View reviewed changes
Copy link
Collaborator

@rudolfix rudolfix left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@rudolfix rudolfix merged commit 775c41f into devel Nov 4, 2024
59 of 61 checks passed
@rudolfix rudolfix deleted the fix/delta-arrow-dictionary-encoded-partition-column branch November 4, 2024 15:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@rudolfix rudolfix rudolfix approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jorritsandbrink @rudolfix