[OKD-SCOS v4.16] UPI install with agent installer fails for 4.16.0-0.okd-scos-2024-07-21-033952

[titou10titou10]

(this is in relation to discussion #1960)

Context

Trying to install a SNO (Single Node) cluster:

• with OKD-SCOS v4.16.0-0.okd-scos-2024-07-21-033952 (an "Accepted" version)
• on baremetal with UPI
• using agent based installer (ABI)
• on vm: 40G RAM, 100G SSD, 10 vCPUS on Proxmox (qemu)

It is important to note that the install works perfectly well with the exact same agent and install config files for OKD-FCOS v4.15.0-0.okd-2024-03-10-010116

I also have tried for a multi-node cluster, it fails the same way

Summary

It fails with the same error as described in #1964 for v4.17:

Failed to register cluster with assisted-service: AssistedServiceError Code: 400 Href:  ID: 400 Kind: Error Reason: pull secret for new cluster is invalid: pull secret must contain auth for \"registry.ci.openshift.org\""

See the detail in #1964

The generated/usr/local/share/assisted-service/assisted-service.envfile in the node still contains

 PUBLIC_CONTAINER_REGISTRIES=quay.io

So the images can not be fetched. Changing it to

PUBLIC_CONTAINER_REGISTRIES=quay.io,registry.ci.openshift.org

and

systemctl restart agent agent-register-cluster agent-register-infraenv assisted-service assisted-service-pod assisted-service-db

does not make the install to succeed. Replacing the installer image by using the latest FCOS stable version by setting

OPENSHIFT_INSTALL_OS_IMAGE_OVERRIDE=https://builds.coreos.fedoraproject.org/prod/streams/stable/builds/40.20240701.3.0/x86_64/fedora-coreos-40.20240701.3.0-live.x86_64.iso

Before generating the iso does not change anything:

export OPENSHIFT_INSTALL_OS_IMAGE_OVERRIDE=https://builds.coreos.fedoraproject.org/prod/streams/stable/builds/40.20240701.3.0/x86_64/fedora-coreos-40.20240701.3.0-live.x86_64.iso
oc adm release extract --command=openshift-install registry.ci.openshift.org/origin/release-scos:4.16.0-0.okd-scos-2024-07-21-033952
./openshift-install agent create image --dir install --log-level=debug

In/usr/local/share/assisted-service/assisted-service.env , setting this makes the install go a little further but fails also

ENABLE_OKD_SUPPORT=false