Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: Add test for struct schema evolution matching by index #11885

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

rui-mo
Copy link
Collaborator

@rui-mo rui-mo commented Dec 17, 2024

The default behavior of schema evolution on struct field is matching by index.
This PR adds corresponding tests for the below cases.

Parquet column schema User-specified output schema Result
row({"a", "c"}) row({"a", "b", "c"}) row(a:a_val, b:c_cal, c:null)
row({"a", "c"}) row({"b"}) Should not be supported, no deletion of subfields
row({"a", "c"}) row({"b", "d"}) row(b:a_val, c:d_val)
row({"a", "c"}) row({}) Should not be supported

@rui-mo rui-mo requested a review from majetideepak as a code owner December 17, 2024 04:01
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 17, 2024
Copy link

netlify bot commented Dec 17, 2024

Deploy Preview for meta-velox canceled.

Name Link
🔨 Latest commit 162255c
🔍 Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/6761090e480e8a0007ecb1f4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants