You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am working on a cloud computing platform and have data symlinked to a s3 bucket. I am trying to copy a zarr file (along with additional files) to another s3 location and am getting these errors for
ERROR "cp ../data/OMEZarr/image.zarr/0/0/0/10/76/5 s3://test_bucket/s5cmd_test/OMEZarr/image.zarr/0/0/0/10/76/5": BodyHashError: failed to compute body hashes caused by: read ../data/OMEZarr/image.zarr/0/0/0/10/76/5
ERROR "cp ../data/OMEZarr/image.zarr/0/0/0/32/37/33 s3://test_bucket/s5cmd_test/OMEZarr/image.zarr/0/0/0/32/37/33": open ../data/OMEZarr/image.zarr/0/0/0/32/37/33: input/output error
A single zarr can contain ~170,000 files and only a subset get these errors. I thought it may be bad symlinks, but if I run the same code again different files will have errors. Also, no error occur with awscli.
Thanks,
Nick
The text was updated successfully, but these errors were encountered:
I am working on a cloud computing platform and have data symlinked to a s3 bucket. I am trying to copy a zarr file (along with additional files) to another s3 location and am getting these errors for
A single zarr can contain ~170,000 files and only a subset get these errors. I thought it may be bad symlinks, but if I run the same code again different files will have errors. Also, no error occur with awscli.
Thanks,
Nick
The text was updated successfully, but these errors were encountered: