Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

issue reading byte array with precision 10 and escale 2 #82

Open
hbanger opened this issue May 7, 2021 · 2 comments
Open

issue reading byte array with precision 10 and escale 2 #82

hbanger opened this issue May 7, 2021 · 2 comments

Comments

@hbanger
Copy link

hbanger commented May 7, 2021

I have the following parquet schema:

field4: BINARY UNCOMPRESSED DO:0 FPO:170 SZ:58/58/1.00 VC:1 ENC:PLAIN,BIT_PACKED ST:[min: 32505002.09, max: 32505002.09, num_nulls: 0]

json:

{"field4":"32505002.09"}

However, if I try to read it I get the following value:

325050020.90

I have more examples:

parquet -> 62753276.08
parquet-pyton-> 627532760.80

parquet ->57768428.82
parquet-pyton->577684288.20

parquet -> 32505002.09
parquet-pyton-> 325050020.90

is that a kind of normal behavior?

Thanks!

@hbanger hbanger changed the title issue reading byte array with scale 10 and precision 2 issue reading byte array with precision 10 and escale 2 May 7, 2021
@jcrobak
Copy link
Owner

jcrobak commented May 9, 2021

This seems like a bug, probably an off by one. Do you happen to have a sample file to reproduce the issue?

@hbanger
Copy link
Author

hbanger commented May 10, 2021

Hi, thank you for the update. I'm attaching the sample file.
sample.parquet.zip

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants