Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow inserting subschemas #3016

Closed
2 tasks
wjones127 opened this issue Oct 17, 2024 · 0 comments · Fixed by #3041
Closed
2 tasks

Allow inserting subschemas #3016

wjones127 opened this issue Oct 17, 2024 · 0 comments · Fixed by #3041
Assignees
Labels
enhancement New feature or request

Comments

@wjones127
Copy link
Contributor

wjones127 commented Oct 17, 2024

If a dataset has columns a, b, c, a user should be able to call dataset.write(..., mode="append") with columns a, b, and it will fill c with null.

Physically, we should allow the new fragments to not include c at all, to save space. This would also open the door for inserting super schemas (which would expand the schema).

Potential follow ups:

@wjones127 wjones127 added the enhancement New feature or request label Oct 17, 2024
@wjones127 wjones127 self-assigned this Oct 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant