Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AWS AMI upload to S3 failed : TotalPartsExceeded #495

Open
ivanbaldo opened this issue Jun 24, 2024 · 0 comments
Open

AWS AMI upload to S3 failed : TotalPartsExceeded #495

ivanbaldo opened this issue Jun 24, 2024 · 0 comments

Comments

@ivanbaldo
Copy link

Hello.
Running this:

podman run \
  --rm \
  -ti \
  -v /var/lib/containers/storage:/var/lib/containers/storage \
   \
   \
  --privileged \
  --net host \
  --pull newer \
  -v ./build:/output \
  -v ./build/store:/store \
  -v /dev/null:/root/.aws/credentials:ro \
   \
  quay.io/centos-bootc/bootc-image-builder \
   \
   \
  --type ami \
  --chown 0:0 \
  --aws-ami-name Netlabs-RHELAI-2024-06-24.x86_64 \
  --aws-bucket rhelai.netlabs.com.uy \
  --aws-region us-east-1 \
  --local \
  quay.io/ai-lab/nvidia-bootc:latest

Failed with:

Uploading image/disk.raw to rhelai.netlabs.com.uy:7b242daf-87f1-4335-a73b-fab5878c9247-disk.raw
48.83 GiB / 85.39 GiB [------------------------------------------------------------->______________________________________________] 57.19% 136.88 MiB p/s
Error: cannot upload AMI: MultipartUpload: upload multipart failed
	upload id: 1CREpYyflDLAT4In7LX0KKXAksg2w_0hVhZSeEmQdBT40JG67Z0ArNukPdQOtPQ5F7fsf.W.VpSOEQsN.PB0_t7xatmAtTPABhsr2usrPPP.mxq_6k30cWz.KXfu.D7tr59jdLjPnwmTXqzMlKoveg--
caused by: TotalPartsExceeded: exceeded total allowed configured MaxUploadParts (10000). Adjust PartSize to fit in this limit
2024/06/24 22:26:31 error: cannot upload AMI: MultipartUpload: upload multipart failed
	upload id: 1CREpYyflDLAT4In7LX0KKXAksg2w_0hVhZSeEmQdBT40JG67Z0ArNukPdQOtPQ5F7fsf.W.VpSOEQsN.PB0_t7xatmAtTPABhsr2usrPPP.mxq_6k30cWz.KXfu.D7tr59jdLjPnwmTXqzMlKoveg--
caused by: TotalPartsExceeded: exceeded total allowed configured MaxUploadParts (10000). Adjust PartSize to fit in this limit

Since the image is already saved locally we should be able to get it's size and use an appropriate PartSize.
Thanks!!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant