Add c6id and r6id adjusted limits to volume_limits.go

[talnevo]

Is this a bug fix or adding new feature?
This is a bug fix.

What is this PR about? / Why do we need it?
This is to solve a situation where the Kubernetes scheduler sends more pods with volumes to a node than the volume limit allows because it is unaware of the true volume limit of nodes based on such instance types.

What testing is done?
No direct testing was performed: Kubernetes tests on nodes based on the r6id.32xlarge instance type have shown that there is a gap between the number of [volume requiring] pods the Kubernetes scheduler allows to run on a node and the number of pods that are able to attach their respective volume. Our research brought us to determine that this is the place to make the change that will fix this problem. Similar issues were observed last year with nodes based on m5d.16xlarge & m5d.24xlarge and later with m6id.16xlarge & m6id.32xlarge. These older issues no longer exist. We concluded that a change to volume_limits.go introduced in March 2022 fixed the problem for m5d instance types and our own PR for m6id in December 2022 fixed the issue for m6id instance types and we want to do the same for r6id and c6id based nodes.
A similar PR for i4i instance types was introduced in July 2023.

[k8s-ci-robot]

Hi @talnevo. Thanks for your PR.

I'm waiting for a kubernetes-sigs member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[torredil]

/ok-to-test

[torredil]

Thank you @talnevo!
/lgtm

[AndrewSirenko]

Thank you for this @talnevo ! We will open a separate PR afterwards for other instance types like r6idn, but for now we can merge this.

[ConnorJC3]

/approve

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ConnorJC3

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [ConnorJC3]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[github-actions]

Code Coverage Diff

File	Old Coverage	New Coverage	Delta
github.com/kubernetes-sigs/aws-ebs-csi-driver/pkg/cloud/cloud.go	82.5%	82.9%	0.4
github.com/kubernetes-sigs/aws-ebs-csi-driver/pkg/driver/controller_modify_volume.go	85.4%	86.2%	0.8