🐛 Adjust e2e test after the repo structure has changed

[michal-gubricky]

What this PR does / why we need it:

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #133

Special notes for your reviewer:

Please confirm that if this PR changes any image versions, then that's the sole change this PR makes.

TODOs:

• squash commits
• include documentation
• add unit tests

[scs-zuul]

Build failed (e2e-quick-test pipeline).
https://zuul.scs.community/t/SCS/buildset/6388db0135d641b08335a616153d08df

❌ e2e-openstack-quick FAILURE in 9m 12s

[scs-zuul]

Build failed (e2e-quick-test pipeline).
https://zuul.scs.community/t/SCS/buildset/a7539fc86cd04bdaa53cd5bff6e53f8a

❌ e2e-openstack-quick FAILURE in 28m 11s

[scs-zuul]

Build failed (e2e-quick-test pipeline).
https://zuul.scs.community/t/SCS/buildset/407ff53b177949e2adbba0341c125927

❌ e2e-openstack-quick FAILURE in 15m 53s

[scs-zuul]

Build failed (e2e-quick-test pipeline).
https://zuul.scs.community/t/SCS/buildset/839dfa3d30cf463681ea2d107c2e119c

❌ e2e-openstack-quick FAILURE in 20m 17s

[scs-zuul]

Build failed (e2e-quick-test pipeline).
https://zuul.scs.community/t/SCS/buildset/39ba7849aa46481eb0fdad830a8006dc

❌ e2e-openstack-quick FAILURE in 18m 38s

[scs-zuul]

Build failed (e2e-quick-test pipeline).
https://zuul.scs.community/t/SCS/buildset/824270ebefad4374bc8fa91397c62c24

❌ e2e-openstack-quick FAILURE in 24m 46s

[scs-zuul]

Build failed (e2e-quick-test pipeline).
https://zuul.scs.community/t/SCS/buildset/338f8b5ee147432ca6a13c266f341cc0

❌ e2e-openstack-quick FAILURE in 22m 15s

[scs-zuul]

Build failed (e2e-quick-test pipeline).
https://zuul.scs.community/t/SCS/buildset/0c70cb8f45ba49e9b5a0f05f4726ed0c

❌ e2e-openstack-quick FAILURE in 18m 42s

[scs-zuul]

Build failed (e2e-quick-test pipeline).
https://zuul.scs.community/t/SCS/buildset/91e9305018cb4d7bb30fca0a7eee3d02

❌ e2e-openstack-quick FAILURE in 14m 41s

[scs-zuul]

Build failed (e2e-test pipeline).
https://zuul.scs.community/t/SCS/buildset/a70b33678cf842c78da8f044ad92185c

❌ e2e-openstack-conformance FAILURE in 18m 55s

[scs-zuul]

Build failed (e2e-quick-test pipeline).
https://zuul.scs.community/t/SCS/buildset/e651cdb2415f42299ec522fbd8e59583

❌ e2e-openstack-quick FAILURE in 15m 34s

[michal-gubricky]

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/e651cdb2415f42299ec522fbd8e59583

❌ e2e-openstack-quick FAILURE in 15m 34s

The template cluster.yaml.j2 needs to be changed as machineDeployments were renamed, see 3e7c580

[chess-knight]

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/e651cdb2415f42299ec522fbd8e59583
❌ e2e-openstack-quick FAILURE in 15m 34s

The template cluster.yaml.j2 needs to be changed as machineDeployments were renamed, see 3e7c580

I merged changes after a failed build. It looks like we have the same problem as in KaaSv1 and should be fixed also here, see SovereignCloudStack/k8s-cluster-api-provider#621

[scs-zuul]

Build failed (e2e-quick-test pipeline).
https://zuul.scs.community/t/SCS/buildset/a1ec74f6057f4b019645654b9e6dbd3e

❌ e2e-openstack-quick FAILURE in 34m 06s

Warning:

SCS Compliance results

Testing SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/cluster_manifest/kubeconfig-test-cluster. INFO: The K8s cluster version 1.28.11 of cluster 'test-cluster-admin@test-cluster' is still in the recency time window.

... returned 0 errors, 0 aborts

---

Testing standard Kubernetes node distribution and availability ...
Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ...

WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes.
WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes.
WARNING: There seems to be no distribution across multiple host-ids or labels aren't set correctly across nodes.
ERROR: The distribution of nodes described in the standard couldn't be detected.
... returned 1 errors, 0 aborts

---

Testing standard CNCF Kubernetes conformance ...
Reference: https://github.com/cncf/k8s-conformance/tree/master ...
WARNING: No check tool specified for CNCF Kubernetes conformance

---

Verdict for subject KaaS_V2, SCS Compatible KaaS, version v2: 1 ERRORS
Testing SCS Compatible KaaS version v1

---

Testing standard Kubernetes version policy ...
Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ...
... returned 0 errors, 0 aborts

---

Testing standard Kubernetes node distribution and availability ...
Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ...
... returned 1 errors, 0 aborts

---

Verdict for subject KaaS_V2, SCS Compatible KaaS, version v1: 1 ERRORS

Sonobouy results

Plugin: e2e Status: passed Total: 7394 Passed: 5 Failed: 0 Skipped: 7389

Plugin: systemd-logs
Status: passed
Total: 4
Passed: 4
Failed: 0
Skipped: 0

Run Details:
API Server version: v1.28.11
Node health: 4/4 (100%)
Pods health: 29/29 (100%)
Errors detected in files:
Errors:
227 podlogs/kube-system/kube-apiserver-test-cluster-n6jgv-dcdk7/logs/kube-apiserver.txt
79 podlogs/kube-system/kube-scheduler-test-cluster-n6jgv-dcdk7/logs/kube-scheduler.txt
39 podlogs/kube-system/kube-proxy-gsx9v/logs/kube-proxy.txt
36 podlogs/kube-system/openstack-cinder-csi-controllerplugin-78c4557887-bvznh/logs/csi-snapshotter.txt
30 podlogs/kube-system/kube-proxy-j2lwd/logs/kube-proxy.txt
23 podlogs/kube-system/kube-controller-manager-test-cluster-n6jgv-dcdk7/logs/kube-controller-manager.txt
6 podlogs/kube-system/cilium-8drfc/logs/cilium-agent.txt
5 podlogs/kube-system/cilium-wbvg7/logs/cilium-agent.txt
5 podlogs/kube-system/cilium-mls4p/logs/cilium-agent.txt
5 podlogs/kube-system/cilium-zgdlg/logs/cilium-agent.txt
2 podlogs/kube-system/etcd-test-cluster-n6jgv-dcdk7/logs/etcd.txt
2 podlogs/kube-system/openstack-cloud-controller-manager-ncvl9/logs/openstack-cloud-controller-manager.txt
2 podlogs/kube-system/cilium-operator-8645b8bb4f-d5m4z/logs/cilium-operator.txt
1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-5lb2k/logs/node-driver-registrar.txt
1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-dzwnh/logs/node-driver-registrar.txt
1 podlogs/kube-system/cilium-operator-8645b8bb4f-k4dwc/logs/cilium-operator.txt
1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-79bb6/logs/node-driver-registrar.txt
1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-vxd55/logs/node-driver-registrar.txt
1 podlogs/sonobuoy/sonobuoy-e2e-job-b2843dd5383e4332/logs/e2e.txt
Warnings:
838 podlogs/kube-system/etcd-test-cluster-n6jgv-dcdk7/logs/etcd.txt
43 podlogs/kube-system/kube-apiserver-test-cluster-n6jgv-dcdk7/logs/kube-apiserver.txt
42 podlogs/kube-system/kube-scheduler-test-cluster-n6jgv-dcdk7/logs/kube-scheduler.txt
18 podlogs/kube-system/openstack-cinder-csi-controllerplugin-78c4557887-bvznh/logs/csi-snapshotter.txt
15 podlogs/kube-system/kube-proxy-gsx9v/logs/kube-proxy.txt
12 podlogs/kube-system/kube-proxy-j2lwd/logs/kube-proxy.txt
10 podlogs/kube-system/openstack-cinder-csi-nodeplugin-dzwnh/logs/node-driver-registrar.txt
6 podlogs/kube-system/openstack-cinder-csi-nodeplugin-vxd55/logs/node-driver-registrar.txt
6 podlogs/kube-system/cilium-zgdlg/logs/cilium-agent.txt
4 podlogs/kube-system/openstack-cloud-controller-manager-ncvl9/logs/openstack-cloud-controller-manager.txt
4 podlogs/kube-system/openstack-cinder-csi-nodeplugin-vxd55/logs/liveness-probe.txt
4 podlogs/kube-system/openstack-cinder-csi-nodeplugin-dzwnh/logs/liveness-probe.txt
2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-5lb2k/logs/node-driver-registrar.txt
2 podlogs/kube-system/cilium-8drfc/logs/cilium-agent.txt
2 podlogs/kube-system/kube-controller-manager-test-cluster-n6jgv-dcdk7/logs/kube-controller-manager.txt
2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-5lb2k/logs/liveness-probe.txt
1 podlogs/sonobuoy/sonobuoy-e2e-job-b2843dd5383e4332/logs/e2e.txt
1 podlogs/sonobuoy/sonobuoy/logs/kube-sonobuoy.txt
1 podlogs/kube-system/cilium-operator-8645b8bb4f-d5m4z/logs/cilium-operator.txt
1 podlogs/kube-system/cilium-wbvg7/logs/cilium-agent.txt
1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-79bb6/logs/liveness-probe.txt
1 podlogs/kube-system/cilium-operator-8645b8bb4f-k4dwc/logs/cilium-operator.txt
1 podlogs/kube-system/openstack-cinder-csi-controllerplugin-78c4557887-bvznh/logs/csi-attacher.txt
1 podlogs/kube-system/cilium-mls4p/logs/cilium-agent.txt
1 podlogs/kube-system/openstack-cinder-csi-controllerplugin-78c4557887-bvznh/logs/csi-provisioner.txt

[scs-zuul]

Zuul encountered a syntax error while parsing its
configuration in the repo SovereignCloudStack/cluster-stacks on branch main. The
problem was:

Job openstack-access-base not defined

The problem appears in the the "openstack-e2e-abstract" job stanza:

job:
name: openstack-e2e-abstract
abstract: true
parent: openstack-access-base
description: |
An abstract job for e2e testing of cluster stacks project.
This job is not intended to be run directly, but instead
must be inherited from it.
pre-run: playbooks/dependencies.yaml
...

in "SovereignCloudStack/cluster-stacks/.zuul.yaml@main", line 2
Warning:
Zuul encountered a deprecated syntax while parsing its
configuration in the repo SovereignCloudStack/cluster-stacks on branch main. The
problem was:

The cleanup-run job attribute is deprecated. Replace it with
post-run playbooks with the cleanup attribute set.

The problem appears in the "cleanup-run" attribute
of the "openstack-e2e-abstract" job stanza:

job:
name: openstack-e2e-abstract
abstract: true
parent: openstack-access-base
description: |
An abstract job for e2e testing of cluster stacks project.
This job is not intended to be run directly, but instead
must be inherited from it.
pre-run: playbooks/dependencies.yaml
...

in "SovereignCloudStack/cluster-stacks/.zuul.yaml@main", line 3