Skip to content

Conversation

@openshift-bot
Copy link
Contributor

disruptions Information

There were (56) added jobs and (112) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 249 jobs increased and 1661 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
gcp-network-liveness-new-connections 4.21 amd64 ovn aws single 133 7m56.8s 97.23% 10m45.68s 36.83%
host-to-pod-reused-connections 4.21 amd64 ovn metal compact 115 1m27.7s 159.85% 9m26.64s 181.49%
host-to-pod-new-connections 4.21 amd64 ovn metal compact 115 1m29.3s 118.87% 9m45.44s 201.21%
gcp-network-liveness-new-connections 4.20 4.20 amd64 ovn azure ha 326 3m19.5s 31.08% 25m52s 251.00%
pod-to-pod-reused-connections 4.21 amd64 ovn metal compact 115 45s 150.00% 2m44.66s 250.41%
openshift-api-http2-localhost-reused-connections 4.21 4.21 amd64 ovn gcp ha 1223 1m6s 57.14% 1m15s 78.57%
openshift-api-http2-localhost-reused-connections 4.21 4.21 amd64 ovn aws ha 661 1m14s 34.06% 1m51.2s 96.33%
openshift-api-http2-localhost-new-connections 4.21 4.21 amd64 ovn aws ha 661 1m13s 32.25% 1m49s 92.44%
kube-api-http1-localhost-reused-connections 4.21 4.21 amd64 ovn aws ha 661 1m4s 33.06% 1m41s 103.55%
kube-api-http1-localhost-new-connections 4.21 4.21 amd64 ovn aws ha 661 1m4s 33.06% 1m41s 103.55%
pod-to-pod-new-connections 4.21 amd64 ovn metal compact 115 35.1s 35.52% 2m41.64s 284.86%
service-load-balancer-with-pdb-reused-connections 4.21 4.21 amd64 ovn azure ha 641 3s 200.00% 3.6s 260.00%
oauth-api-new-connections 4.21 ppc64le ovn none ha 127 5.4s 35.00% 9.22s 44.51%
kube-api-http2-service-network-reused-connections 4.21 4.20 amd64 ovn azure ha 1030 2s 100.00% 12.55s 43.43%
azure-network-liveness-reused-connections 4.20 4.20 amd64 ovn aws ha 373 1.4s 40.00% 23.4s 140.74%
image-registry-reused-connections 4.20 4.19 amd64 ovn gcp ha 677 1s 0.00% 2s 100.00%
openshift-api-http2-service-network-reused-connections 4.20 4.19 amd64 ovn vsphere ha 103 1s 0.00% 44.14s 2129.29%
image-registry-new-connections 4.20 4.19 amd64 ovn azure ha 667 0s 0.00% 2.7s 170.00%
kube-api-http2-localhost-new-connections 4.20 amd64 ovn aws ha 233 1m19.4s 0.00% 2m9.08s 35.19%
image-registry-new-connections 4.20 arm64 ovn aws ha 168 1s 0.00% 24.33s 2333.00%
openshift-api-http2-localhost-reused-connections 4.20 amd64 ovn aws ha 233 1m31s 0.00% 2m22.44s 30.54%
kube-api-http2-internal-lb-new-connections 4.20 4.19 amd64 ovn gcp ha 677 0s 0.00% 3.68s 268.00%
kube-api-http1-localhost-new-connections 4.20 amd64 ovn aws ha 233 1m19.4s 0.00% 2m9.08s 35.19%
azure-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 742 6m18.3s 0.00% 19m12.62s 76.19%
pod-to-host-new-connections 4.20 s390x ovn none ha 125 800ms 0.00% 2m21.16s 346.71%
kube-api-http1-localhost-reused-connections 4.20 amd64 ovn aws ha 233 1m20s 0.00% 2m9.08s 35.19%
openshift-api-http2-internal-lb-new-connections 4.20 4.20 amd64 ovn azure ha 326 0s 0.00% 6.25s 388.28%
openshift-api-http2-internal-lb-new-connections 4.20 4.19 amd64 ovn gcp ha 677 0s 0.00% 2.72s 172.00%
ci-cluster-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 742 0s 0.00% 20.44s 117.91%
kube-api-reused-connections 4.20 4.20 amd64 ovn azure ha 326 1s 0.00% 2.75s 37.50%
gcp-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 742 3m10.95s 0.00% 13m54.16s 90.92%
ingress-to-oauth-server-new-connections 4.20 4.19 amd64 ovn azure ha 667 0s 0.00% 2s 100.00%
kube-api-http1-internal-lb-new-connections 4.20 4.19 amd64 ovn gcp ha 677 0s 0.00% 3.24s 224.00%
aws-network-liveness-new-connections 4.20 4.20 amd64 ovn aws single 305 0s 0.00% 960ms 1500.00%
service-load-balancer-with-pdb-new-connections 4.20 4.19 amd64 ovn aws ha 741 0s 0.00% 1.56s 56.00%
azure-network-liveness-new-connections 4.20 4.20 amd64 ovn azure ha 326 4m59s 0.00% 34m10s 209.19%
cache-kube-api-new-connections 4.20 ppc64le ovn none ha 335 2s 0.00% 5.32s 33.00%
openshift-api-reused-connections 4.20 arm64 ovn aws ha 168 1s 0.00% 2s 100.00%
kube-api-http2-internal-lb-new-connections 4.20 4.20 amd64 ovn azure ha 326 0s 0.00% 1s 614.29%
kube-api-http2-localhost-reused-connections 4.20 amd64 ovn aws ha 233 1m19.4s 0.00% 2m9.08s 35.19%
host-to-host-new-connections 4.20 s390x ovn none ha 125 800ms 0.00% 2m17.84s 320.24%
ingress-to-console-new-connections 4.20 4.19 amd64 ovn azure ha 667 0s 0.00% 2.34s 87.20%
ingress-to-oauth-server-new-connections 4.21 amd64 ovn none single 158 1m49s 0.00% 1m52.43s 6077.47%
oauth-api-reused-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 3.11s 211.00%
openshift-api-http2-internal-lb-new-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 2s 100.00%
ci-cluster-network-liveness-new-connections 4.21 amd64 ovn azure external 383 0s 0.00% 180ms 100.00%
kube-api-http2-internal-lb-reused-connections 4.21 amd64 ovn gcp ha 104 0s 0.00% 2s 100.00%
ingress-to-console-new-connections 4.21 arm64 ovn aws ha 194 0s 0.00% 1s 122.22%
ci-cluster-network-liveness-new-connections 4.21 4.21 amd64 ovn aws single 589 0s 0.00% 18.12s 251.84%
host-to-service-reused-connections 4.21 4.21 amd64 ovn aws single 589 600ms 0.00% 23.24s 119.25%
ingress-to-oauth-server-reused-connections 4.21 amd64 ovn aws single 133 7s 0.00% 13.08s 49.49%
ingress-to-oauth-server-new-connections 4.21 4.21 amd64 ovn gcp ha 1223 1s 0.00% 2s 106.19%
pod-to-host-new-connections 4.21 4.21 amd64 ovn aws single 589 0s 0.00% 1s 566.67%
pod-to-service-reused-connections 4.21 4.21 amd64 ovn aws single 589 7s 0.00% 26.72s 57.18%
openshift-api-http2-localhost-new-connections 4.21 amd64 ovn metal compact 115 37m12.3s 0.00% 1h3m36.66s 42.85%
kube-api-http2-internal-lb-new-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 1s 525.00%
openshift-api-http2-localhost-reused-connections 4.21 amd64 ovn metal compact 115 19m49.1s 0.00% 33m51.52s 52.27%
cache-oauth-api-new-connections 4.21 amd64 ovn metal compact 115 1s 0.00% 1.86s 86.00%
kube-api-http2-service-network-reused-connections 4.21 arm64 ovn aws ha 194 0s 0.00% 1s 122.22%
service-load-balancer-with-pdb-new-connections 4.21 arm64 ovn aws ha 194 0s 0.00% 1s 122.22%
ingress-to-console-new-connections 4.21 4.20 amd64 ovn aws ha 1190 1s 0.00% 4s 33.33%
cache-kube-api-new-connections 4.21 amd64 ovn metal compact 115 1s 0.00% 1.86s 86.00%
pod-to-service-new-connections 4.21 arm64 ovn aws ha 194 0s 0.00% 1s 122.22%
ingress-to-console-new-connections 4.21 amd64 ovn none single 158 1m49s 0.00% 1m52.43s 12254.95%
oauth-api-new-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 4s 33.33%
ingress-to-oauth-server-new-connections 4.21 ppc64le ovn none ha 127 3s 0.00% 7.48s 57.14%
kube-api-http1-localhost-reused-connections 4.21 amd64 ovn metal compact 115 21m55.7s 0.00% 38m10.4s 59.22%
host-to-service-new-connections 4.21 4.21 amd64 ovn aws single 589 1s 0.00% 23.24s 119.25%
cache-kube-api-new-connections 4.21 ppc64le ovn none ha 127 5s 0.00% 8.48s 32.92%
pod-to-service-new-connections 4.21 4.21 amd64 ovn aws single 589 7s 0.00% 26.72s 57.18%
openshift-api-new-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 4.11s 37.00%
host-to-host-new-connections 4.21 amd64 ovn metal compact 115 1h19m35.8s 0.00% 2h19m45.82s 41.06%
kube-api-http2-localhost-reused-connections 4.21 amd64 ovn metal compact 115 18m54s 0.00% 36m56.38s 56.20%
image-registry-reused-connections 4.21 4.21 amd64 ovn gcp ha 1223 1s 0.00% 2.78s 39.00%
ingress-to-console-new-connections 4.21 ppc64le ovn none ha 127 3s 0.00% 6.48s 47.95%
kube-api-reused-connections 4.21 ppc64le ovn none ha 127 0s 0.00% 740ms 94.74%
kube-api-http2-localhost-new-connections 4.21 amd64 ovn metal compact 115 37m32.7s 0.00% 1h3m13.2s 40.51%
ci-cluster-network-liveness-new-connections 4.21 amd64 ovn metal compact 115 0s 0.00% 29.76s 87.88%
openshift-api-new-connections 4.21 4.21 amd64 ovn gcp ha 1223 1s 0.00% 4.78s 392.78%
kube-api-http1-localhost-new-connections 4.21 amd64 ovn metal compact 115 38m35.4s 0.00% 1h4m15.78s 41.90%
host-to-service-new-connections 4.21 arm64 ovn aws ha 194 0s 0.00% 1s 122.22%
cache-openshift-api-reused-connections 4.21 4.21 amd64 ovn azure ha 643 1s 0.00% 2s 104.08%
ci-cluster-network-liveness-new-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 7s 75.00%
openshift-api-new-connections 4.21 amd64 ovn metal compact 115 1s 0.00% 1.86s 86.00%
kube-api-reused-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 2.11s 81.90%
ci-cluster-network-liveness-new-connections 4.21 amd64 ovn vsphere ha 133 0s 0.00% 11.2s 1020.00%
host-to-host-reused-connections 4.21 amd64 ovn metal compact 115 43m37.5s 0.00% 1h24m41.38s 56.50%

alerts Information

There were (2496) added jobs and (1234) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 37 jobs increased and 359 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.21 4.21 amd64 ovn aws ha 242 2m26.5s 3388.10% 6m28s 243.67%
NodeSystemSaturation openshift-monitoring Warning 4.21 4.21 amd64 ovn aws ha 242 4m26.5s 80.07% 17m3.4s 49.86%
NodeSystemSaturation openshift-monitoring Warning 4.21 4.20 amd64 ovn gcp ha 229 1m46s 530.95% 18m47.2s 67.94%
CannotRetrieveUpdates openshift-cluster-version Warning 4.20 amd64 ovn vsphere ha 230 2m27.4s 0.00% 29m11.46s 31.78%
NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn metal ha 347 58s 0.00% 19m43.12s 100.58%
NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn aws single 118 5m28s 0.00% 13m16.86s 49.22%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.21 arm64 ovn aws ha 133 0s 0.00% 2m38.8s 388.62%
NodeSystemSaturation openshift-monitoring Warning 4.21 amd64 ovn metal ha 329 1m10.8s 0.00% 6m40.64s 33.77%
HighOverallControlPlaneMemory openshift-machine-config-operator Warning 4.21 amd64 ovn gcp ha 183 0s 0.00% 9m57s 225.31%
NodeSystemSaturation openshift-monitoring Warning 4.21 amd64 ovn vsphere ha 238 0s 0.00% 11m18.1s 137.10%
NodeSystemSaturation openshift-monitoring Warning 4.21 4.20 amd64 ovn azure ha 262 58s 0.00% 7m25s 57.24%
NodeSystemSaturation openshift-monitoring Warning 4.21 arm64 ovn aws ha 133 4m10s 0.00% 26m8.8s 182.16%
NodeSystemSaturation openshift-monitoring Warning 4.21 amd64 ovn azure ha 133 0s 0.00% 12m19.28s 228.86%
/cc @xueqzhan, @neisw, @smg247

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Oct 31, 2025
@openshift-ci-robot
Copy link

@openshift-bot: This pull request explicitly references no jira issue.

In response to this:

disruptions Information

There were (56) added jobs and (112) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 249 jobs increased and 1661 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
gcp-network-liveness-new-connections 4.21 amd64 ovn aws single 133 7m56.8s 97.23% 10m45.68s 36.83%
host-to-pod-reused-connections 4.21 amd64 ovn metal compact 115 1m27.7s 159.85% 9m26.64s 181.49%
host-to-pod-new-connections 4.21 amd64 ovn metal compact 115 1m29.3s 118.87% 9m45.44s 201.21%
gcp-network-liveness-new-connections 4.20 4.20 amd64 ovn azure ha 326 3m19.5s 31.08% 25m52s 251.00%
pod-to-pod-reused-connections 4.21 amd64 ovn metal compact 115 45s 150.00% 2m44.66s 250.41%
openshift-api-http2-localhost-reused-connections 4.21 4.21 amd64 ovn gcp ha 1223 1m6s 57.14% 1m15s 78.57%
openshift-api-http2-localhost-reused-connections 4.21 4.21 amd64 ovn aws ha 661 1m14s 34.06% 1m51.2s 96.33%
openshift-api-http2-localhost-new-connections 4.21 4.21 amd64 ovn aws ha 661 1m13s 32.25% 1m49s 92.44%
kube-api-http1-localhost-reused-connections 4.21 4.21 amd64 ovn aws ha 661 1m4s 33.06% 1m41s 103.55%
kube-api-http1-localhost-new-connections 4.21 4.21 amd64 ovn aws ha 661 1m4s 33.06% 1m41s 103.55%
pod-to-pod-new-connections 4.21 amd64 ovn metal compact 115 35.1s 35.52% 2m41.64s 284.86%
service-load-balancer-with-pdb-reused-connections 4.21 4.21 amd64 ovn azure ha 641 3s 200.00% 3.6s 260.00%
oauth-api-new-connections 4.21 ppc64le ovn none ha 127 5.4s 35.00% 9.22s 44.51%
kube-api-http2-service-network-reused-connections 4.21 4.20 amd64 ovn azure ha 1030 2s 100.00% 12.55s 43.43%
azure-network-liveness-reused-connections 4.20 4.20 amd64 ovn aws ha 373 1.4s 40.00% 23.4s 140.74%
image-registry-reused-connections 4.20 4.19 amd64 ovn gcp ha 677 1s 0.00% 2s 100.00%
openshift-api-http2-service-network-reused-connections 4.20 4.19 amd64 ovn vsphere ha 103 1s 0.00% 44.14s 2129.29%
image-registry-new-connections 4.20 4.19 amd64 ovn azure ha 667 0s 0.00% 2.7s 170.00%
kube-api-http2-localhost-new-connections 4.20 amd64 ovn aws ha 233 1m19.4s 0.00% 2m9.08s 35.19%
image-registry-new-connections 4.20 arm64 ovn aws ha 168 1s 0.00% 24.33s 2333.00%
openshift-api-http2-localhost-reused-connections 4.20 amd64 ovn aws ha 233 1m31s 0.00% 2m22.44s 30.54%
kube-api-http2-internal-lb-new-connections 4.20 4.19 amd64 ovn gcp ha 677 0s 0.00% 3.68s 268.00%
kube-api-http1-localhost-new-connections 4.20 amd64 ovn aws ha 233 1m19.4s 0.00% 2m9.08s 35.19%
azure-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 742 6m18.3s 0.00% 19m12.62s 76.19%
pod-to-host-new-connections 4.20 s390x ovn none ha 125 800ms 0.00% 2m21.16s 346.71%
kube-api-http1-localhost-reused-connections 4.20 amd64 ovn aws ha 233 1m20s 0.00% 2m9.08s 35.19%
openshift-api-http2-internal-lb-new-connections 4.20 4.20 amd64 ovn azure ha 326 0s 0.00% 6.25s 388.28%
openshift-api-http2-internal-lb-new-connections 4.20 4.19 amd64 ovn gcp ha 677 0s 0.00% 2.72s 172.00%
ci-cluster-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 742 0s 0.00% 20.44s 117.91%
kube-api-reused-connections 4.20 4.20 amd64 ovn azure ha 326 1s 0.00% 2.75s 37.50%
gcp-network-liveness-new-connections 4.20 4.20 amd64 ovn gcp ha 742 3m10.95s 0.00% 13m54.16s 90.92%
ingress-to-oauth-server-new-connections 4.20 4.19 amd64 ovn azure ha 667 0s 0.00% 2s 100.00%
kube-api-http1-internal-lb-new-connections 4.20 4.19 amd64 ovn gcp ha 677 0s 0.00% 3.24s 224.00%
aws-network-liveness-new-connections 4.20 4.20 amd64 ovn aws single 305 0s 0.00% 960ms 1500.00%
service-load-balancer-with-pdb-new-connections 4.20 4.19 amd64 ovn aws ha 741 0s 0.00% 1.56s 56.00%
azure-network-liveness-new-connections 4.20 4.20 amd64 ovn azure ha 326 4m59s 0.00% 34m10s 209.19%
cache-kube-api-new-connections 4.20 ppc64le ovn none ha 335 2s 0.00% 5.32s 33.00%
openshift-api-reused-connections 4.20 arm64 ovn aws ha 168 1s 0.00% 2s 100.00%
kube-api-http2-internal-lb-new-connections 4.20 4.20 amd64 ovn azure ha 326 0s 0.00% 1s 614.29%
kube-api-http2-localhost-reused-connections 4.20 amd64 ovn aws ha 233 1m19.4s 0.00% 2m9.08s 35.19%
host-to-host-new-connections 4.20 s390x ovn none ha 125 800ms 0.00% 2m17.84s 320.24%
ingress-to-console-new-connections 4.20 4.19 amd64 ovn azure ha 667 0s 0.00% 2.34s 87.20%
ingress-to-oauth-server-new-connections 4.21 amd64 ovn none single 158 1m49s 0.00% 1m52.43s 6077.47%
oauth-api-reused-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 3.11s 211.00%
openshift-api-http2-internal-lb-new-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 2s 100.00%
ci-cluster-network-liveness-new-connections 4.21 amd64 ovn azure external 383 0s 0.00% 180ms 100.00%
kube-api-http2-internal-lb-reused-connections 4.21 amd64 ovn gcp ha 104 0s 0.00% 2s 100.00%
ingress-to-console-new-connections 4.21 arm64 ovn aws ha 194 0s 0.00% 1s 122.22%
ci-cluster-network-liveness-new-connections 4.21 4.21 amd64 ovn aws single 589 0s 0.00% 18.12s 251.84%
host-to-service-reused-connections 4.21 4.21 amd64 ovn aws single 589 600ms 0.00% 23.24s 119.25%
ingress-to-oauth-server-reused-connections 4.21 amd64 ovn aws single 133 7s 0.00% 13.08s 49.49%
ingress-to-oauth-server-new-connections 4.21 4.21 amd64 ovn gcp ha 1223 1s 0.00% 2s 106.19%
pod-to-host-new-connections 4.21 4.21 amd64 ovn aws single 589 0s 0.00% 1s 566.67%
pod-to-service-reused-connections 4.21 4.21 amd64 ovn aws single 589 7s 0.00% 26.72s 57.18%
openshift-api-http2-localhost-new-connections 4.21 amd64 ovn metal compact 115 37m12.3s 0.00% 1h3m36.66s 42.85%
kube-api-http2-internal-lb-new-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 1s 525.00%
openshift-api-http2-localhost-reused-connections 4.21 amd64 ovn metal compact 115 19m49.1s 0.00% 33m51.52s 52.27%
cache-oauth-api-new-connections 4.21 amd64 ovn metal compact 115 1s 0.00% 1.86s 86.00%
kube-api-http2-service-network-reused-connections 4.21 arm64 ovn aws ha 194 0s 0.00% 1s 122.22%
service-load-balancer-with-pdb-new-connections 4.21 arm64 ovn aws ha 194 0s 0.00% 1s 122.22%
ingress-to-console-new-connections 4.21 4.20 amd64 ovn aws ha 1190 1s 0.00% 4s 33.33%
cache-kube-api-new-connections 4.21 amd64 ovn metal compact 115 1s 0.00% 1.86s 86.00%
pod-to-service-new-connections 4.21 arm64 ovn aws ha 194 0s 0.00% 1s 122.22%
ingress-to-console-new-connections 4.21 amd64 ovn none single 158 1m49s 0.00% 1m52.43s 12254.95%
oauth-api-new-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 4s 33.33%
ingress-to-oauth-server-new-connections 4.21 ppc64le ovn none ha 127 3s 0.00% 7.48s 57.14%
kube-api-http1-localhost-reused-connections 4.21 amd64 ovn metal compact 115 21m55.7s 0.00% 38m10.4s 59.22%
host-to-service-new-connections 4.21 4.21 amd64 ovn aws single 589 1s 0.00% 23.24s 119.25%
cache-kube-api-new-connections 4.21 ppc64le ovn none ha 127 5s 0.00% 8.48s 32.92%
pod-to-service-new-connections 4.21 4.21 amd64 ovn aws single 589 7s 0.00% 26.72s 57.18%
openshift-api-new-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 4.11s 37.00%
host-to-host-new-connections 4.21 amd64 ovn metal compact 115 1h19m35.8s 0.00% 2h19m45.82s 41.06%
kube-api-http2-localhost-reused-connections 4.21 amd64 ovn metal compact 115 18m54s 0.00% 36m56.38s 56.20%
image-registry-reused-connections 4.21 4.21 amd64 ovn gcp ha 1223 1s 0.00% 2.78s 39.00%
ingress-to-console-new-connections 4.21 ppc64le ovn none ha 127 3s 0.00% 6.48s 47.95%
kube-api-reused-connections 4.21 ppc64le ovn none ha 127 0s 0.00% 740ms 94.74%
kube-api-http2-localhost-new-connections 4.21 amd64 ovn metal compact 115 37m32.7s 0.00% 1h3m13.2s 40.51%
ci-cluster-network-liveness-new-connections 4.21 amd64 ovn metal compact 115 0s 0.00% 29.76s 87.88%
openshift-api-new-connections 4.21 4.21 amd64 ovn gcp ha 1223 1s 0.00% 4.78s 392.78%
kube-api-http1-localhost-new-connections 4.21 amd64 ovn metal compact 115 38m35.4s 0.00% 1h4m15.78s 41.90%
host-to-service-new-connections 4.21 arm64 ovn aws ha 194 0s 0.00% 1s 122.22%
cache-openshift-api-reused-connections 4.21 4.21 amd64 ovn azure ha 643 1s 0.00% 2s 104.08%
ci-cluster-network-liveness-new-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 7s 75.00%
openshift-api-new-connections 4.21 amd64 ovn metal compact 115 1s 0.00% 1.86s 86.00%
kube-api-reused-connections 4.21 4.20 amd64 ovn aws ha 1190 0s 0.00% 2.11s 81.90%
ci-cluster-network-liveness-new-connections 4.21 amd64 ovn vsphere ha 133 0s 0.00% 11.2s 1020.00%
host-to-host-reused-connections 4.21 amd64 ovn metal compact 115 43m37.5s 0.00% 1h24m41.38s 56.50%

alerts Information

There were (2496) added jobs and (1234) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 37 jobs increased and 359 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.21 4.21 amd64 ovn aws ha 242 2m26.5s 3388.10% 6m28s 243.67%
NodeSystemSaturation openshift-monitoring Warning 4.21 4.21 amd64 ovn aws ha 242 4m26.5s 80.07% 17m3.4s 49.86%
NodeSystemSaturation openshift-monitoring Warning 4.21 4.20 amd64 ovn gcp ha 229 1m46s 530.95% 18m47.2s 67.94%
CannotRetrieveUpdates openshift-cluster-version Warning 4.20 amd64 ovn vsphere ha 230 2m27.4s 0.00% 29m11.46s 31.78%
NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn metal ha 347 58s 0.00% 19m43.12s 100.58%
NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn aws single 118 5m28s 0.00% 13m16.86s 49.22%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.21 arm64 ovn aws ha 133 0s 0.00% 2m38.8s 388.62%
NodeSystemSaturation openshift-monitoring Warning 4.21 amd64 ovn metal ha 329 1m10.8s 0.00% 6m40.64s 33.77%
HighOverallControlPlaneMemory openshift-machine-config-operator Warning 4.21 amd64 ovn gcp ha 183 0s 0.00% 9m57s 225.31%
NodeSystemSaturation openshift-monitoring Warning 4.21 amd64 ovn vsphere ha 238 0s 0.00% 11m18.1s 137.10%
NodeSystemSaturation openshift-monitoring Warning 4.21 4.20 amd64 ovn azure ha 262 58s 0.00% 7m25s 57.24%
NodeSystemSaturation openshift-monitoring Warning 4.21 arm64 ovn aws ha 133 4m10s 0.00% 26m8.8s 182.16%
NodeSystemSaturation openshift-monitoring Warning 4.21 amd64 ovn azure ha 133 0s 0.00% 12m19.28s 228.86%
/cc @xueqzhan, @neisw, @smg247

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci bot requested review from deads2k and sjenning October 31, 2025 01:06
@openshift-trt
Copy link

openshift-trt bot commented Oct 31, 2025

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 37c0117

Job Name New Test Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift-serial High - "[sig-apps] Daemon set [Serial] should rollback without unnecessary restarts [Conformance]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift-serial High - "[sig-apps] Daemon set [Serial] should update pod when spec was updated and update strategy is RollingUpdate [Conformance]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2 High - "[sig-apps] Daemon set [Serial] should update pod when spec was updated and update strategy is RollingUpdate [Conformance]" is a new test that failed 1 time(s) against the current commit

New tests seen in this PR at sha: 37c0117

  • "[sig-api-machinery] Garbage collector should keep the rc around until all its pods are deleted if the deleteOptions says so [Serial] [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-api-machinery] Garbage collector should not delete dependents that have both valid owner and owner that's waiting for dependents to be deleted [Serial] [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-api-machinery] Garbage collector should orphan pods created by rc if delete options say so [Serial] [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-api-machinery] Namespaces [Serial] should apply a finalizer to a Namespace [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-api-machinery] Namespaces [Serial] should apply an update to a Namespace [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-api-machinery] Namespaces [Serial] should apply changes to a namespace status [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-api-machinery] Namespaces [Serial] should ensure that all pods are removed when a namespace is deleted [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-api-machinery] Namespaces [Serial] should ensure that all services are removed when a namespace is deleted [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-api-machinery] Namespaces [Serial] should patch a Namespace [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-apps] ControllerRevision [Serial] should manage the lifecycle of a ControllerRevision [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-apps] Daemon set [Serial] should list and delete a collection of DaemonSets [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-apps] Daemon set [Serial] should retry creating failed daemon pods [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-apps] Daemon set [Serial] should rollback without unnecessary restarts [Conformance]" [Total: 2, Pass: 1, Fail: 1, Flake: 0]
  • "[sig-apps] Daemon set [Serial] should run and stop complex daemon [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-apps] Daemon set [Serial] should run and stop simple daemon [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-apps] Daemon set [Serial] should update pod when spec was updated and update strategy is RollingUpdate [Conformance]" [Total: 2, Pass: 0, Fail: 2, Flake: 0]
  • "[sig-apps] Daemon set [Serial] should verify changes to a daemon set status [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-node] NoExecuteTaintManager Multiple Pods [Serial] evicts pods with minTolerationSeconds [Disruptive] [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-node] NoExecuteTaintManager Single Pod [Serial] removing taint cancels eviction [Disruptive] [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-scheduling] SchedulerPredicates [Serial] validates resource limits of pods that are allowed to run [Conformance]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • (...showing 20 of 29 tests)

@neisw
Copy link
Contributor

neisw commented Nov 3, 2025

/lgtm
/retest-required

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Nov 3, 2025
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Nov 3, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: neisw, openshift-bot

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Nov 3, 2025
@neisw
Copy link
Contributor

neisw commented Nov 4, 2025

/verified bypass
/override ci/prow/e2e-metal-ipi-ovn-ipv6

tests passed but failed gather extra

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Nov 4, 2025

@neisw: Overrode contexts on behalf of neisw: ci/prow/e2e-metal-ipi-ovn-ipv6

In response to this:

/verified bypass
/override ci/prow/e2e-metal-ipi-ovn-ipv6

tests passed but failed gather extra

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@openshift-ci-robot openshift-ci-robot added the verified Signifies that the PR passed pre-merge verification criteria label Nov 4, 2025
@openshift-ci-robot
Copy link

@neisw: The verified label has been added.

In response to this:

/verified bypass
/override ci/prow/e2e-metal-ipi-ovn-ipv6

tests passed but failed gather extra

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 560414a and 2 for PR HEAD 37c0117 in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD b115048 and 1 for PR HEAD 37c0117 in total

@neisw
Copy link
Contributor

neisw commented Nov 4, 2025

/retest-required

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 2d22e87 and 0 for PR HEAD 37c0117 in total

@neisw
Copy link
Contributor

neisw commented Nov 5, 2025

/retest-required

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Nov 5, 2025

@openshift-bot: all tests passed!

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-merge-bot openshift-merge-bot bot merged commit 2d78d5d into openshift:main Nov 5, 2025
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged. verified Signifies that the PR passed pre-merge verification criteria

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants