[WIP] Add conformance testing to clusterctl framework

[randomvariable]

What this PR does / why we need it:

• Helpers for running kubetest (for e2e or conformance) against a cluster provisioned using the clusterctl
  test framework
• Adds mechanism to set a Kubernetes version based on the latest CI artifacts
• Can run kubetest from the latest CI artifacts using Docker against a workload proxy

Based on port with additional cleanup of kubernetes-sigs/cluster-api-provider-aws#1760:

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #2141
Fixes #3569

[fabriziopandini]

/assign

[CecileRobertMichon]

/assign

/cc @chewong

[fabriziopandini]

@randomvariable thanks for this PR!
First of all, a background question: This code runs the kubernetes e2e test in a container using docker,
pointing to a cluster identified by a cluster proxy, is that right?

Given that this is a really valuable utility, I have left some comments in order to check if we can achieve a better decoupling from the clusterctl config, thus allowing usage of this utility in a stand-alone way.

[randomvariable]

This code runs the kubernetes e2e test in a container using docker, pointing to a cluster identified by a cluster proxy, is that right?

Yup, that's right. Thanks for the comments, the way it is now is sort of based on the history of moving the old CAPA scripts from bash to go, so should be able to address in a cleaner way.

[randomvariable]

Will be returning to this soon, but @sedefsavas discovered that in CAPA, the conformance test fails to run on OS X due to docker volume mount issues when running the kubetest image.

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
To complete the pull request process, please assign cecilerobertmichon
You can assign the PR to them by writing /assign @cecilerobertmichon in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[randomvariable]

/close

Temporarily closing whilst I constantly push WIP bits to test on the Mac on the other screen.

[k8s-ci-robot]

@randomvariable: Closed this PR.

In response to this:

/close

Temporarily closing whilst I constantly push WIP bits to test on the Mac on the other screen.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[randomvariable]

Got this working on MacOS

/reopen

[k8s-ci-robot]

@randomvariable: Failed to re-open PR: state cannot be changed. The conformance branch was force-pushed or recreated.

In response to this:

Got this working on MacOS

/reopen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.