Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generic S3 error: Client error with status 411 Length Required #6831

Open
andrew-pienso opened this issue Dec 3, 2024 · 0 comments
Open
Labels

Comments

@andrew-pienso
Copy link

Describe the bug
Using delta-rs to write to gcp configured s3 storage yields a 411 error.

Relevant ticket in delta-rs: delta-io/delta-rs#2394

To Reproduce
delta-io/delta-rs#2394 (comment)

Expected behavior
Should be able to use gcp configured s3 storage.

Additional context
I did some digging and it appears this may have been fixed at one point by #4518
but was then regressed by 8731760#diff-0feb099a0931110c214fa9b9c8c5528512f38ebf22448772a815baee5973b8c4L354-L357

I also noticed that the aws client doesn't currently appear to pass content length of zero:
https://github.com/apache/arrow-rs/blob/main/object_store/src/aws/client.rs#L615

Yet the gcp client does: https://github.com/apache/arrow-rs/blob/main/object_store/src/gcp/client.rs#L441

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant