Restrict Group inheritance to Before|AfterGroups #684
test.yml
on: pull_request
Matrix Preparation
7s
Matrix: build
Annotations
11 errors and 22 warnings
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU:
RetryAnalyzerTest.java#L55
0.0sec test.retryAnalyzer.RetryAnalyzerTest > ensureNoDuplicateRetryAnalyzerInstancesAreCreated
java.lang.AssertionError: There should have been 2 RetryAnalyser instances since the data driven test has 2 sets of data
at test.retryAnalyzer.RetryAnalyzerTest.ensureNoDuplicateRetryAnalyzerInstancesAreCreated(RetryAnalyzerTest.java:55)
|
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU:
RetryAnalyzerTest.java#L259
0.0sec test.retryAnalyzer.RetryAnalyzerTest > ensureRetryDoesntRunEndlesslyForDataDrivenTests
java.lang.AssertionError:
Expected size: 21 but was: 9 in:
["Executing willNotStopAfter3Failures",
"Executing willNotStopAfter3Failures",
"Executing willNotStopAfter3Failures",
"Executing willNotStopAfter3Failures",
"Executing willNotStopAfter3Failures",
"Executing willNotStopAfter3Failures",
"Executing willNotStopAfter3Failures",
"Executing willNotStopAfter3Failures",
"Executing willNotStopAfter3Failures"]
at test.retryAnalyzer.RetryAnalyzerTest.ensureRetryDoesntRunEndlesslyForDataDrivenTests(RetryAnalyzerTest.java:259)
|
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU:
task ':testng-core:test'#L1
Execution failed for task ':testng-core:test':
org.gradle.api.tasks.VerificationException: There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
|
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU
Execution failed for task ':testng-core:test'.
> There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
|
11, Liberica, ubuntu, America/New_York, tr_TR:
EfficientPriorityParallelizationTest2.java#L283
0.0sec test.priority.parallel.EfficientPriorityParallelizationTest2 > verifyThatSlowMethodStartedFirstAndEndedLast
java.lang.AssertionError: All the test two methods should run between when test one starts and ends.
Start Event: EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.HighPriorityTestSample, Class instance hash code: 1227593995, Method name: slowMethod, Time of event: 2023-11-02 01:25:13.286, Thread ID: 5939}.
In between events: [EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodA, Time of event: 2023-11-02 01:25:13.285, Thread ID: 5940}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodA, Time of event: 2023-11-02 01:25:13.785, Thread ID: 5940}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodA, Time of event: 2023-11-02 01:25:13.835, Thread ID: 5940}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodB, Time of event: 2023-11-02 01:25:14.335, Thread ID: 5940}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodB, Time of event: 2023-11-02 01:25:14.835, Thread ID: 5940}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodB, Time of event: 2023-11-02 01:25:14.885, Thread ID: 5940}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodC, Time of event: 2023-11-02 01:25:15.386, Thread ID: 5940}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodC, Time of event: 2023-11-02 01:25:15.886, Thread ID: 5940}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodC, Time of event: 2023-11-02 01:25:15.936, Thread ID: 5940}].
Final event: EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.HighPriorityTestSample, Class instance hash code: 1227593995, Method name: slowMethod, Time of event: 2023-11-02 01:25:17.787, Thread ID: 5939} expected [true] but found [false]
at org.testng.Assert.fail(Assert.java:111)
at org.testng.Assert.failNotEquals(Assert.java:1578)
at org.testng.Assert.assertTrue(Assert.java:57)
at test.thread.parallelization.BaseParallelizationTest.verifyEventsOccurBetween(BaseParallelizationTest.java:236)
at test.priority.parallel.EfficientPriorityParallelizationTest2.verifyThatSlowMethodStartedFirstAndEndedLast(EfficientPriorityParallelizationTest2.java:283)
|
11, Liberica, ubuntu, America/New_York, tr_TR:
task ':testng-core:test'#L1
Execution failed for task ':testng-core:test':
org.gradle.api.tasks.VerificationException: There were failing tests. See the report at: file:///home/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
|
11, Liberica, ubuntu, America/New_York, tr_TR
Execution failed for task ':testng-core:test'.
> There were failing tests. See the report at: file:///home/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
|
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT:
ParallelByMethodsTestCase7Scenario2.java#L518
0.0sec test.thread.parallelization.ParallelByMethodsTestCase7Scenario2 > verifyThatTestMethodsRunInParallelThreads
java.lang.AssertionError: Expected 40 test method start event logs to be in a block of methods executing in parallel. Found an event log of a different type in the block being processed: [EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 334189371, Method name: testMethodA, Time of event: 2023-11-02 05:28:06.251, Thread ID: 5785}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1228285628, Method name: testMethodA, Time of event: 2023-11-02 05:28:06.252, Thread ID: 5786}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1446442779, Method name: testMethodA, Time of event: 2023-11-02 05:28:06.252, Thread ID: 5787}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 334189371, Method name: testMethodB, Time of event: 2023-11-02 05:28:06.252, Thread ID: 5788}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1228285628, Method name: testMethodB, Time of event: 2023-11-02 05:28:06.261, Thread ID: 5789}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1446442779, Method name: testMethodB, Time of event: 2023-11-02 05:28:06.262, Thread ID: 5790}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 334189371, Method name: testMethodC, Time of event: 2023-11-02 05:28:06.429, Thread ID: 5791}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1228285628, Method name: testMethodC, Time of event: 2023-11-02 05:28:06.786, Thread ID: 5792}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 334189371, Method name: testMethodA, Data provider param: paramThree, Time of event: 2023-11-02 05:28:06.786, Thread ID: 5785}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1446442779, Method name: testMethodA, Data provider param: paramTwo, Time of event: 2023-11-02 05:28:06.787, Thread ID: 5787}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 334189371, Method name: testMethodB, Data provider param: paramThree, Time of event: 2023-11-02 05:28:06.787, Thread ID: 5788}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteB, Test: TestSuit
|
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT:
ParallelByMethodsTestCase8Scenario1.java#L1015
0.0sec test.thread.parallelization.ParallelByMethodsTestCase8Scenario1 > verifyThatTestMethodsRunInParallelThreads
java.lang.AssertionError: Expected 10 test method start event logs to be in a block of methods executing in parallel. Found an event log of a different type in the block being processed: [EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1257226064, Method name: testMethodA, Time of event: 2023-11-02 05:28:11.480, Thread ID: 5830}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1794663289, Method name: testMethodA, Time of event: 2023-11-02 05:28:11.876, Thread ID: 5831}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1257226064, Method name: testMethodA, Data provider param: paramTwo, Time of event: 2023-11-02 05:28:12.070, Thread ID: 5830}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 2084103034, Method name: testMethodA, Time of event: 2023-11-02 05:28:12.264, Thread ID: 5832}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1257226064, Method name: testMethodA, Time of event: 2023-11-02 05:28:12.264, Thread ID: 5830}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1794663289, Method name: testMethodA, Data provider param: paramOne, Time of event: 2023-11-02 05:28:12.458, Thread ID: 5831}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1257226064, Method name: testMethodB, Time of event: 2023-11-02 05:28:12.654, Thread ID: 5833}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1794663289, Method name: testMethodA, Time of event: 2023-11-02 05:28:12.655, Thread ID: 5831}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1794663289, Method name: testMethodB, Time of event: 2023-11-02 05:28:12.733, Thread ID: 5834}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 2084103034, Method name: testMethodB, Time of event: 2023-11-02 05:28:12.733, Thread ID: 5835}] expected [true] but found [false]
at org.testng.Assert.fail(Assert.java:111)
at org.testng.Assert.failNotEquals(Assert.java:1578)
at org.testng.Assert.assertTrue(Assert.java:57)
at test.thread.parallelization.BaseParallelizationTest.verifyEventTypeForEventsLogs(BaseParallelizationTest.java:103)
at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethodListenerStartEvents(BaseParallelizationTest.java:754)
|
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT:
task ':testng-core:test'#L1
Execution failed for task ':testng-core:test':
org.gradle.api.tasks.VerificationException: There were failing tests. See the report at: file:///D:/a/testng/testng/testng-core/build/reports/tests/test/index.html
|
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT
Execution failed for task ':testng-core:test'.
> There were failing tests. See the report at: file:///D:/a/testng/testng/testng-core/build/reports/tests/test/index.html
|
Matrix Preparation
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
|
17, Zulu, ubuntu, UTC, fr_FR
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
17, Zulu, ubuntu, UTC, fr_FR
Gradle Build Scan: https://gradle.com/s/ncpu6i26zhkus
|
17, Zulu, ubuntu, UTC, fr_FR
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
17, Adopt Hotspot, ubuntu, UTC, de_DE, stress JIT
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
17, Adopt Hotspot, ubuntu, UTC, de_DE, stress JIT
Gradle Build Scan: https://gradle.com/s/s5snsz2koglw6
|
17, Adopt Hotspot, ubuntu, UTC, de_DE, stress JIT
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
11, Zulu, ubuntu, UTC, tr_TR, stress JIT
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
11, Zulu, ubuntu, UTC, tr_TR, stress JIT
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
11, Zulu, ubuntu, UTC, tr_TR, stress JIT
Gradle Build Scan: https://gradle.com/s/twm2q3dpnculc
|
17, Adopt Hotspot, ubuntu, UTC, ru_RU
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
17, Adopt Hotspot, ubuntu, UTC, ru_RU
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
17, Adopt Hotspot, ubuntu, UTC, ru_RU
Gradle Build Scan: https://gradle.com/s/4fuwz37mp4xfa
|
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU
Gradle Build Scan: https://gradle.com/s/qf5osemxaems4
|
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
11, Liberica, ubuntu, America/New_York, tr_TR
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
11, Liberica, ubuntu, America/New_York, tr_TR
Gradle Build Scan: https://gradle.com/s/e7ls2ezzgxdym
|
11, Liberica, ubuntu, America/New_York, tr_TR
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT
distributionSha256Sum is not set in gradle\wrapper\gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT
distributionSha256Sum is not set in gradle\wrapper\gradle-wrapper.properties.
Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
|
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT
Gradle Build Scan: https://gradle.com/s/xt5hnpubsg2uk
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
build-reports-Liberica-11-1698902268
Expired
|
1.82 MB |
|
build-reports-Zulu-11-
Expired
|
1.61 MB |
|
build-reports-Zulu-17-1698902270
Expired
|
1.52 MB |
|