Build Issue Summary for 2024-11-25

[github-actions]

Summary

Build failures: 12
Test failures: 15

TRSS Pipeline Links

JDK8: https://trss.adoptium.net/resultSummary?parentId=6736653a9e1252006ee056d8
JDK8 Alpine: https://trss.adoptium.net/resultSummary?parentId=673669fc9e1252006ee09041
JDK11: https://trss.adoptium.net/resultSummary?parentId=673e4e129e1252006edbdbea
JDK17: https://trss.adoptium.net/resultSummary?parentId=673e476a9e1252006edbda60
JDK21: https://trss.adoptium.net/resultSummary?parentId=6737a90e9e1252006efcc148
JDK23: https://trss.adoptium.net/resultSummary?parentId=67388aa79e1252006e1c58dd
JDK24: https://trss.adoptium.net/resultSummary?parentId=6738f9dd9e1252006e2f78ee

Failed Builds

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-temurin/533/
Cause: Error/exception found.
Preventable: no

[2024-11-15T02:00:19.368Z] org.jenkinsci.plugins.ParameterizedRemoteTrigger.exceptions.ExceedRetryLimitException: Max number of connection retries have been exeeded.

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-aix-ppc64-temurin/484/
Cause: Error/exception found.
Preventable: no

[2024-11-14T21:10:55.191Z] Execution error: hudson.AbortException: script returned exit code 1

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-aarch64-temurin/361/
Cause: Error/exception found.
Preventable: no

[2024-11-20T21:02:02.985Z] Execution error: hudson.AbortException: script returned exit code 1

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-alpine-linux-x64-temurin/102/
Cause: Error/exception found.
Preventable: no

[2024-11-16T06:37:28.566Z] Execution error: org.jenkinsci.plugins.workflow.support.steps.AgentOfflineException: Unable to create live FilePath for build-linux-x64-49aa30; build-linux-x64-49aa30 was marked offline: Node is being removed

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-mac-x64-temurin/179/
Cause: No error found

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-mac-aarch64-temurin/163/
Cause: No error found

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23u/job/jdk23u-mac-x64-temurin/6/
Cause: No error found

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23u/job/jdk23u-mac-aarch64-temurin/6/
Cause: No error found

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-s390x-temurin/307/
Cause: Error/exception found.
Preventable: no

[2024-11-18T14:31:49.492Z] Execution error: java.lang.Exception: [ERROR] Build JDK timeout (8 HOURS) has been reached. Exiting...

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-aarch64-temurin/368/
Cause: No error found

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-aarch64-temurin/384/
Cause: Error/exception found.
Preventable: no

[2024-11-16T20:04:40.858Z] Execution error: java.io.IOException: Failed to run top '14ea1025e8624e49ef01efb3fca0f8464e54d83a3160295a3409b04669858513'. Error: Error response from daemon: container 14ea1025e8624e49ef01efb3fca0f8464e54d83a3160295a3409b04669858513 is not running

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-temurin/357/
Cause: No error found

Builds with Failed Tests (suspected)

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-x64-temurin/500/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-14T21:38:31.402Z] Build Test_openjdk8_hs_sanity.external_x86-64_linux #614 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-sparcv9-temurin/496/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-15T01:24:47.897Z] Build Test_openjdk8_hs_sanity.openjdk_sparcv9_solaris #427 completed: ABORTED

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-x64-temurin/426/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-21T07:06:49.860Z] Build Test_openjdk11_hs_dev.openjdk_x86-64_linux #29 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-arm-temurin/365/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-20T21:41:59.366Z] Build Test_openjdk11_hs_sanity.functional_arm_linux #443 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk17u/job/jdk17u-linux-x64-temurin/624/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-21T01:48:35.754Z] Build Test_openjdk17_hs_sanity.external_x86-64_linux #39 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk17u/job/jdk17u-linux-arm-temurin/373/
Cause: Smoke test failed.
Preventable: no

[2024-11-20T22:17:08.305Z] Build build-scripts » jobs » jdk17u » jdk17u-linux-arm-temurin_SmokeTests #259 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk17u/job/jdk17u-linux-ppc64le-temurin/475/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-20T23:18:55.393Z] Build Test_openjdk17_hs_sanity.system_ppc64le_linux #437 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-alpine-linux-aarch64-temurin/111/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-17T03:19:53.159Z] Build Test_openjdk21_hs_sanity.openjdk_aarch64_alpine-linux #62 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-linux-riscv64-temurin/71/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-18T03:58:56.000Z] Build Test_openjdk21_hs_sanity.openjdk_riscv64_linux #215 completed: ABORTED

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-linux-x64-temurin/294/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-15T20:41:35.434Z] Build Test_openjdk21_hs_sanity.external_x86-64_linux #40 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23u/job/jdk23u-aix-ppc64-temurin/6/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-17T10:11:45.465Z] Build Test_openjdk23_hs_sanity.openjdk_ppc64_aix #25 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23u/job/jdk23u-linux-ppc64le-temurin/6/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-16T18:39:53.065Z] Build Test_openjdk23_hs_special.system_ppc64le_linux #6 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23u/job/jdk23u-alpine-linux-aarch64-temurin/6/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-18T05:16:33.105Z] Build Test_openjdk23_hs_sanity.openjdk_aarch64_alpine-linux #35 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23u/job/jdk23u-linux-riscv64-temurin/21/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-11-18T03:06:54.714Z] Build Test_openjdk23_hs_extended.openjdk_riscv64_linux #32 completed: ABORTED

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-alpine-linux-x64-temurin/331/
Cause: Smoke test failed.
Preventable: no

[2024-11-18T14:31:42.323Z] Build build-scripts » jobs » jdk » jdk-alpine-linux-x64-temurin_SmokeTests #209 completed: ABORTED

End of list

Script Issues

• Issue 0: Could not find all three of the pipelines for jdk8. Will triage the pipelines we could find.
• Issue 1: Error: Platform linux-arm should be built for jdk8u, but was not launched.
• Issue 2: Error: Platform windows-x64 should be built for jdk, but was not launched.

End of Issues

[adamfarley]

Build Triage

https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23u/job/jdk23u-mac-x64-temurin/6/
https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-mac-x64-temurin/179/
https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-mac-aarch64-temurin/163/
https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-aarch64-temurin/368/
https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-temurin/357/
Ignoring these because orka now seems fine, and is able to generate the required machines.
All of these listed failures have a minimum of one passing/unstable build that ran afterwards.

20:01:32  All nodes of label ‘[xcode15.0.1&&build&&mac&&x64](https://ci.adoptium.net/label/xcode15.0.1&&build&&mac&&x64/)’ are offline

---

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-temurin/533/
Cause: Error/exception found.
Preventable: no

[2024-11-15T02:00:19.368Z] org.jenkinsci.plugins.ParameterizedRemoteTrigger.exceptions.ExceedRetryLimitException: Max number of connection retries have been exeeded.

Cause: Looks like the TCK server could not be reached at some stage:

Connection to remote server failed [Connect timed out], waiting to retry - 10 seconds until next attempt. URL: https://ci.eclipse.org/temurin-compliance/job/AQA_Test_Pipeline/api/json, parameters:

I can reach this file now, so will assume that this is a one-off until proven otherwise. Rerunning job now.
https://ci.adoptium.net/job/build-scripts/job/openjdk8-pipeline/2950/console

---

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-aix-ppc64-temurin/484/

21:10:24  gmake[6]: *** [/home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-aix-ppc64-temurin/workspace/build/src/hotspot/make/aix/makefiles/rules.make:151: loopnode.o] Error 1

Upstream bug: https://bugs.openjdk.org/browse/JDK-8342822

Fix is not yet complete/merged/propagated.

---

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-aarch64-temurin/361/

21:02:24  Downloading ga release of boot JDK version 10 from https://api.adoptium.net/v3/binary/latest/10/ga/mac/aarch64/jdk/hotspot/normal/eclipse
21:02:24  Downloading ga release of boot JDK version 10 from https://api.adoptium.net/v3/binary/latest/10/ga/mac/aarch64/jdk/hotspot/normal/adoptium
21:02:25  Downloading ga release of boot JDK version 10 from https://api.adoptium.net/v3/binary/latest/10/ga/mac/aarch64/jdk/hotspot/normal/adoptopenjdk
21:02:26  Downloading ga release of boot JDK version 10 from https://api.adoptopenjdk.net/v3/binary/latest/10/ga/mac/aarch64/jdk/hotspot/normal/eclipse
21:02:26  Downloading ga release of boot JDK version 10 from https://api.adoptopenjdk.net/v3/binary/latest/10/ga/mac/aarch64/jdk/hotspot/normal/adoptium
21:02:27  Downloading ga release of boot JDK version 10 from https://api.adoptopenjdk.net/v3/binary/latest/10/ga/mac/aarch64/jdk/hotspot/normal/adoptopenjdk
21:02:27  Downloading ea release of boot JDK version 10 from https://api.adoptium.net/v3/binary/latest/10/ea/mac/aarch64/jdk/hotspot/normal/eclipse
21:02:27  Downloading ea release of boot JDK version 10 from https://api.adoptium.net/v3/binary/latest/10/ea/mac/aarch64/jdk/hotspot/normal/adoptium
21:02:28  Downloading ea release of boot JDK version 10 from https://api.adoptium.net/v3/binary/latest/10/ea/mac/aarch64/jdk/hotspot/normal/adoptopenjdk
21:02:28  Downloading ea release of boot JDK version 10 from https://api.adoptopenjdk.net/v3/binary/latest/10/ea/mac/aarch64/jdk/hotspot/normal/eclipse
21:02:29  Downloading ea release of boot JDK version 10 from https://api.adoptopenjdk.net/v3/binary/latest/10/ea/mac/aarch64/jdk/hotspot/normal/adoptium
21:02:29  Downloading ea release of boot JDK version 10 from https://api.adoptopenjdk.net/v3/binary/latest/10/ea/mac/aarch64/jdk/hotspot/normal/adoptopenjdk
21:02:30  BOOT JDK: /Users/admin/workspace/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-aarch64-temurin/build-farm/platform-specific-configurations/mac.sh: line 146: /Users/admin/workspace/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-aarch64-temurin/jdk10/Contents/Home/bin/java: No such file or directory

Looks like the adoptium api does not supply jdk10 builds, so I'm raising an issue. Link.
Update: 3 weeks ago (before the first failures) it looks like we changed the boot jdk path, so we're now looking for it in a different (wrong?) location. Have added solution ideas to the issue.

---

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-alpine-linux-x64-temurin/102/
Cause: Error/exception found.
Preventable: no

[2024-11-16T06:37:28.566Z] Execution error: org.jenkinsci.plugins.workflow.support.steps.AgentOfflineException: Unable to create live FilePath for build-linux-x64-49aa30; build-linux-x64-49aa30 was marked offline: Node is being removed

Looks like an admin issue, where a node was deleted mid-build. The next build passed on a different node.

---

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-s390x-temurin/307/
Cause: Error/exception found.
Preventable: no

[2024-11-18T14:31:49.492Z] Execution error: java.lang.Exception: [ERROR] Build JDK timeout (8 HOURS) has been reached. Exiting...

Looks like it wasn't a timeout. The "cancelled" signal from the parent pipeline is just being misinterpreted. Odd.

---

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-aarch64-temurin/384/
Cause: Error/exception found.
Preventable: no

20:01:14  $ docker run -t -d -u 1000:1000 -e BUILDIMAGESHA=adoptopenjdk/centos7_build_image@sha256:156841911a8923d6f14c6575bdc839be4d23346309fd602ddbad90099076222e
20:01:14   --init -w /home/jenkins/workspace/build-scripts/jobs/jdk/jdk-linux-aarch64-temurin -v /home/jenkins/workspace/build-scripts/jobs/jdk/jdk-linux-aarch64-temurin:/home/jenkins/workspace/build-scripts/jobs/jdk/jdk-linux-aarch64-temurin:rw,z -v /home/jenkins/workspace/build-scripts/jobs/jdk/jdk-linux-aarch64-temurin@tmp:/home/jenkins/workspace/build-scripts/jobs/jdk/jdk-linux-aarch64-temurin@tmp:rw,z -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** adoptopenjdk/centos7_build_image cat
20:04:15  ERROR: Timeout after 180 seconds

The next build passed on the same machine: dockerhost-equinix-ubuntu2204-armv8-1
https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-aarch64-temurin/385/

[adamfarley]

Test Job Failure Triage

https://ci.adoptium.net/job/Test_openjdk8_hs_sanity.external_x86-64_linux/614/
https://ci.adoptium.net/job/Test_openjdk21_hs_sanity.external_x86-64_linux/40/
Docker daemon not running - solved here

---

https://ci.adoptium.net/job/Test_openjdk11_hs_sanity.external_x86-64_linux/650/
tty not present on machine
Known issue: adoptium/infrastructure#3128 (comment)

---

https://ci.adoptium.net/job/Test_openjdk17_hs_sanity.external_x86-64_linux/39/

[2024-11-21T01:48:22.718Z]         [INFO] [ERROR] Failed to execute goal io.quarkus:quarkus-maven-plugin:2.7.5.Final:build (default) on project kubernetes-docker-build-and-deploy-deployment: Failed to build quarkus application: io.quarkus.builder.BuildException: Build failure: Build failed due to errors
[2024-11-21T01:48:22.718Z]         [INFO] [ERROR] 	[error]: Build step io.quarkus.kubernetes.deployment.KubernetesDeployer#deploy threw an exception: java.lang.RuntimeException: Although a Kubernetes deployment was requested, it however cannot take place because there was an error during communication with the API Server at 'http://localhost:12345/'
[2024-11-21T01:48:22.718Z]         [INFO] [ERROR] 	at io.quarkus.kubernetes.deployment.KubernetesDeploy.doCheck(KubernetesDeploy.java:90)
...
[2024-11-21T01:48:22.718Z]         [INFO] [ERROR] Caused by: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred.
[2024-11-21T01:48:22.718Z]         [INFO] [ERROR] 	at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:103)
...
[2024-11-21T01:48:22.718Z]         [INFO] [ERROR] 	... 13 more
[2024-11-21T01:48:22.718Z]         [INFO] [ERROR] Caused by: java.net.ConnectException: Failed to connect to localhost/127.0.0.1:12345
[2024-11-21T01:48:22.718Z]         [INFO] [ERROR] 	at okhttp3.internal.connection.RealConnection.connectSocket(RealConnection.java:265)
...
[2024-11-21T01:48:22.719Z]         [INFO] [ERROR] 	... 16 more
[2024-11-21T01:48:22.719Z]         [INFO] [ERROR] Caused by: java.net.ConnectException: Connection refused
[2024-11-21T01:48:22.719Z]         [INFO] [ERROR] 	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
[...
[2024-11-21T01:48:22.719Z]         [INFO] [ERROR] 	... 52 more
[2024-11-21T01:48:22.719Z]         [INFO] [ERROR] -> [Help 1]
[2024-11-21T01:48:22.719Z]         [INFO] [ERROR] 
[2024-11-21T01:48:22.719Z]         [INFO] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.

At a guess, the OOM that occurred shortly before this failure could have been an OOM in the test-initiated service that this is failing to contact.

---

https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-alpine-linux-x64-temurin_SmokeTests/209/
Pipeline cancelled by user. Next smoke test passed.

---

https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk17u/job/jdk17u-linux-arm-temurin_SmokeTests/259/

22:17:00  tar: jdk-17.0.14+4/legal/jdk.hotspot.agent/LICENSE: Cannot change mode to rwxrwxr-x: Operation not permitted
22:17:00  tar: jdk-17.0.14+4/legal/jdk.hotspot.agent/ADDITIONAL_LICENSE_INFO: Cannot change mode to rwxrwxr-x: Operation not permitted
22:17:00  tar: jdk-17.0.14+4/legal/jdk.hotspot.agent/ASSEMBLY_EXCEPTION: Cannot change mode to rwxrwxr-x: Operation not permitted

Etc. All files were within "jdk-17.0.14+4/legal"
This is a known issue. Updated with a comment.
adoptium/infrastructure#3547 (comment)

---

https://ci.adoptium.net/job/Test_openjdk21_hs_special.system_x86-64_linux/35/

21:04:54  build.sh : 21:04:50 : Build complete ...
21:09:46  Should be in the opetee: write error
21:09:46  autoGen.mk:26: recipe for target 'Rebuild_Same_JDK_Reproducibility_Test_0' failed

Odd error. I think "opentee" is a portmanteau of "openjdk" and "tee", as tee has failed mid-sentence, maybe due to a disk space issue.
Rerunning this test on the same machine here: https://ci.adoptium.net/job/Grinder/11811/
Still happens. Raised an issue here.

---

Untriaged:
https://ci.adoptium.net/job/Test_openjdk8_hs_sanity.openjdk_sparcv9_solaris/427/
https://ci.adoptium.net/job/Test_openjdk8_hs_extended.functional_sparcv9_solaris/413/
https://ci.adoptium.net/job/Test_openjdk11_hs_dev.openjdk_x86-64_linux/29/
https://ci.adoptium.net/job/Test_openjdk11_hs_sanity.openjdk_arm_linux/517/
https://ci.adoptium.net/job/Test_openjdk11_hs_dev.functional_arm_linux/35/
https://ci.adoptium.net/job/Test_openjdk11_hs_extended.openjdk_arm_linux/165/
https://ci.adoptium.net/job/Test_openjdk17_hs_sanity.system_ppc64le_linux/437/
https://ci.adoptium.net/job/Test_openjdk21_hs_sanity.openjdk_aarch64_alpine-linux/62/
https://ci.adoptium.net/job/Test_openjdk21_hs_sanity.openjdk_riscv64_linux/215/
https://ci.adoptium.net/job/Test_openjdk21_hs_special.system_x86-64_linux/35/
https://ci.adoptium.net/job/Test_openjdk23_hs_sanity.openjdk_ppc64_aix/25/
https://ci.adoptium.net/job/Test_openjdk23_hs_special.system_ppc64le_linux/6/
https://ci.adoptium.net/job/Test_openjdk23_hs_extended.openjdk_aarch64_alpine-linux/35/
https://ci.adoptium.net/job/Test_openjdk23_hs_sanity.openjdk_aarch64_alpine-linux/35/
https://ci.adoptium.net/job/Test_openjdk23_hs_extended.openjdk_riscv64_linux/32/