Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add Amazon S3's parallel SHA2-256 (#343)
When data is uploaded to S3 in can be chunked. Each chunk is hashed, those hashes are then concatenated and hashes again into a single hash. Quilt is using 8MiB chunks, but increases the size in case the input is large, as the maximum size of chunks is 10k. For all details about the hash algorithm see: https://github.com/quiltdata/quilt/blob/fb36269def0f8b811e0c1293fcf3e853732a7b71/docs/sha2-256-chunked.md
- Loading branch information