Parquet schema hint doesn't support integer types upcasting #6891
Labels
development-process
Related to development process of arrow-rs
enhancement
Any new improvement worthy of a entry in the changelog
parquet
Changes to the parquet crate
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
The present matching logic for overriding a Parquet schema doesn't support Integer up-casting
arrow-rs/parquet/src/arrow/schema/primitive.rs
Lines 40 to 49 in 123045c
Describe the solution you'd like
I'd like to be able to override any integer type as long is avoids precision loss (though it could be argued that even this is too conservative).
Describe alternatives you've considered
Apply some kind of a schema adapter/mask at a higher level, e.g. via some DataFusion extension mechanism.
Additional context
Related to apache/iceberg-rust#813.
The text was updated successfully, but these errors were encountered: