Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow loading data from public S3 buckets without credentials #6401

Closed
fm3 opened this issue Aug 15, 2022 · 2 comments · Fixed by #6421
Closed

Allow loading data from public S3 buckets without credentials #6401

fm3 opened this issue Aug 15, 2022 · 2 comments · Fixed by #6421

Comments

@fm3
Copy link
Member

fm3 commented Aug 15, 2022

When attempting to load zarr data from public S3 buckets without credentials, The S3 file system errors with Unable to load AWS credentials from any provider in the chain – We should double-check if the S3 client ( https://github.com/lasersonlab/Amazon-S3-FileSystem-NIO2 ) has an option similar to anon=True in python ( compare https://github.com/fsspec/s3fs/blob/2a53f0f4b64edf315df52898bdbaabcca3a54e1f/s3fs/core.py#L428-L444 ). If not, we may want to implement it

@jstriebel
Copy link
Contributor

This PR at an upstream project might help:
Upplication/Amazon-S3-FileSystem-NIO2#107

@fm3
Copy link
Member Author

fm3 commented Aug 18, 2022

Thanks for having a look! That upstream PR is actually from the fork we are using, though. It is not really related to this issue. I’ll dig into the code some more

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants