You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Nov 16, 2023. It is now read-only.
I'm trying to use this module to read an existing Parquet file and write out a modified Parquet file. For example, I would like to transform a single column from one type to another. Or in other cases I would like to modify the compression used when writing.
I've had some luck creating a writer using the schema from an input file:
And then I later write a modified version of the rows (e.g. after transforming some values to a different type):
writer.WriteRows(modifiedRows)
This works except that the output schema is wrong for the columns where I have transformed values.
I recognize that this may not be how this module is intended to be used. If it does sound like a reasonable thing to do, can anyone provide advice on how I might clone an existing schema and make modifications to one or more of the field types?
The text was updated successfully, but these errors were encountered:
Apologies to make more work for you, but we've decided to move development on this project to a new organization at https://github.com/parquet-go/parquet-go to ensure its long term success. We appreciate your contribution and would appreciate if you could reopen this ticket there if it is still relevant.
Sign up for freeto subscribe to this conversation on GitHub.
Already have an account?
Sign in.
I'm trying to use this module to read an existing Parquet file and write out a modified Parquet file. For example, I would like to transform a single column from one type to another. Or in other cases I would like to modify the compression used when writing.
I've had some luck creating a writer using the schema from an input file:
And then I later write a modified version of the rows (e.g. after transforming some values to a different type):
This works except that the output schema is wrong for the columns where I have transformed values.
I recognize that this may not be how this module is intended to be used. If it does sound like a reasonable thing to do, can anyone provide advice on how I might clone an existing schema and make modifications to one or more of the field types?
The text was updated successfully, but these errors were encountered: