Skip to content

Restrict Group inheritance to Before|AfterGroups #684

Restrict Group inheritance to Before|AfterGroups

Restrict Group inheritance to Before|AfterGroups #684

Triggered via pull request November 2, 2023 05:17
Status Failure
Total duration 13m 46s
Artifacts 3

test.yml

on: pull_request
Matrix Preparation
7s
Matrix Preparation
Matrix: build
Fit to window
Zoom out
Zoom in

Annotations

11 errors and 22 warnings
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU: RetryAnalyzerTest.java#L55
0.0sec test.retryAnalyzer.RetryAnalyzerTest > ensureNoDuplicateRetryAnalyzerInstancesAreCreated java.lang.AssertionError: There should have been 2 RetryAnalyser instances since the data driven test has 2 sets of data at test.retryAnalyzer.RetryAnalyzerTest.ensureNoDuplicateRetryAnalyzerInstancesAreCreated(RetryAnalyzerTest.java:55)
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU: RetryAnalyzerTest.java#L259
0.0sec test.retryAnalyzer.RetryAnalyzerTest > ensureRetryDoesntRunEndlesslyForDataDrivenTests java.lang.AssertionError: Expected size: 21 but was: 9 in: ["Executing willNotStopAfter3Failures", "Executing willNotStopAfter3Failures", "Executing willNotStopAfter3Failures", "Executing willNotStopAfter3Failures", "Executing willNotStopAfter3Failures", "Executing willNotStopAfter3Failures", "Executing willNotStopAfter3Failures", "Executing willNotStopAfter3Failures", "Executing willNotStopAfter3Failures"] at test.retryAnalyzer.RetryAnalyzerTest.ensureRetryDoesntRunEndlesslyForDataDrivenTests(RetryAnalyzerTest.java:259)
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.tasks.VerificationException: There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU
Execution failed for task ':testng-core:test'. > There were failing tests. See the report at: file:///Users/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
11, Liberica, ubuntu, America/New_York, tr_TR: EfficientPriorityParallelizationTest2.java#L283
0.0sec test.priority.parallel.EfficientPriorityParallelizationTest2 > verifyThatSlowMethodStartedFirstAndEndedLast java.lang.AssertionError: All the test two methods should run between when test one starts and ends. Start Event: EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.HighPriorityTestSample, Class instance hash code: 1227593995, Method name: slowMethod, Time of event: 2023-11-02 01:25:13.286, Thread ID: 5939}. In between events: [EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodA, Time of event: 2023-11-02 01:25:13.285, Thread ID: 5940}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodA, Time of event: 2023-11-02 01:25:13.785, Thread ID: 5940}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodA, Time of event: 2023-11-02 01:25:13.835, Thread ID: 5940}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodB, Time of event: 2023-11-02 01:25:14.335, Thread ID: 5940}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodB, Time of event: 2023-11-02 01:25:14.835, Thread ID: 5940}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodB, Time of event: 2023-11-02 01:25:14.885, Thread ID: 5940}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodC, Time of event: 2023-11-02 01:25:15.386, Thread ID: 5940}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodC, Time of event: 2023-11-02 01:25:15.886, Thread ID: 5940}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.LowPriorityTestSample, Class instance hash code: 2040264477, Method name: testMethodC, Time of event: 2023-11-02 01:25:15.936, Thread ID: 5940}]. Final event: EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-HighPriorityTestClassTest, Class: test.priority.parallel.HighPriorityTestSample, Class instance hash code: 1227593995, Method name: slowMethod, Time of event: 2023-11-02 01:25:17.787, Thread ID: 5939} expected [true] but found [false] at org.testng.Assert.fail(Assert.java:111) at org.testng.Assert.failNotEquals(Assert.java:1578) at org.testng.Assert.assertTrue(Assert.java:57) at test.thread.parallelization.BaseParallelizationTest.verifyEventsOccurBetween(BaseParallelizationTest.java:236) at test.priority.parallel.EfficientPriorityParallelizationTest2.verifyThatSlowMethodStartedFirstAndEndedLast(EfficientPriorityParallelizationTest2.java:283)
11, Liberica, ubuntu, America/New_York, tr_TR: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.tasks.VerificationException: There were failing tests. See the report at: file:///home/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
11, Liberica, ubuntu, America/New_York, tr_TR
Execution failed for task ':testng-core:test'. > There were failing tests. See the report at: file:///home/runner/work/testng/testng/testng-core/build/reports/tests/test/index.html
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT: ParallelByMethodsTestCase7Scenario2.java#L518
0.0sec test.thread.parallelization.ParallelByMethodsTestCase7Scenario2 > verifyThatTestMethodsRunInParallelThreads java.lang.AssertionError: Expected 40 test method start event logs to be in a block of methods executing in parallel. Found an event log of a different type in the block being processed: [EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 334189371, Method name: testMethodA, Time of event: 2023-11-02 05:28:06.251, Thread ID: 5785}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1228285628, Method name: testMethodA, Time of event: 2023-11-02 05:28:06.252, Thread ID: 5786}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1446442779, Method name: testMethodA, Time of event: 2023-11-02 05:28:06.252, Thread ID: 5787}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 334189371, Method name: testMethodB, Time of event: 2023-11-02 05:28:06.252, Thread ID: 5788}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1228285628, Method name: testMethodB, Time of event: 2023-11-02 05:28:06.261, Thread ID: 5789}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1446442779, Method name: testMethodB, Time of event: 2023-11-02 05:28:06.262, Thread ID: 5790}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 334189371, Method name: testMethodC, Time of event: 2023-11-02 05:28:06.429, Thread ID: 5791}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1228285628, Method name: testMethodC, Time of event: 2023-11-02 05:28:06.786, Thread ID: 5792}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 334189371, Method name: testMethodA, Data provider param: paramThree, Time of event: 2023-11-02 05:28:06.786, Thread ID: 5785}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1446442779, Method name: testMethodA, Data provider param: paramTwo, Time of event: 2023-11-02 05:28:06.787, Thread ID: 5787}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteB, Test: TestSuiteB-ThreeTestClassTest, Class: test.thread.parallelization.sample.TestClassDThreeMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 334189371, Method name: testMethodB, Data provider param: paramThree, Time of event: 2023-11-02 05:28:06.787, Thread ID: 5788}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteB, Test: TestSuit
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT: ParallelByMethodsTestCase8Scenario1.java#L1015
0.0sec test.thread.parallelization.ParallelByMethodsTestCase8Scenario1 > verifyThatTestMethodsRunInParallelThreads java.lang.AssertionError: Expected 10 test method start event logs to be in a block of methods executing in parallel. Found an event log of a different type in the block being processed: [EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1257226064, Method name: testMethodA, Time of event: 2023-11-02 05:28:11.480, Thread ID: 5830}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1794663289, Method name: testMethodA, Time of event: 2023-11-02 05:28:11.876, Thread ID: 5831}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1257226064, Method name: testMethodA, Data provider param: paramTwo, Time of event: 2023-11-02 05:28:12.070, Thread ID: 5830}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 2084103034, Method name: testMethodA, Time of event: 2023-11-02 05:28:12.264, Thread ID: 5832}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1257226064, Method name: testMethodA, Time of event: 2023-11-02 05:28:12.264, Thread ID: 5830}, EventLog{Event: TEST_METHOD_EXECUTION, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1794663289, Method name: testMethodA, Data provider param: paramOne, Time of event: 2023-11-02 05:28:12.458, Thread ID: 5831}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1257226064, Method name: testMethodB, Time of event: 2023-11-02 05:28:12.654, Thread ID: 5833}, EventLog{Event: LISTENER_TEST_METHOD_PASS, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1794663289, Method name: testMethodA, Time of event: 2023-11-02 05:28:12.655, Thread ID: 5831}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 1794663289, Method name: testMethodB, Time of event: 2023-11-02 05:28:12.733, Thread ID: 5834}, EventLog{Event: LISTENER_TEST_METHOD_START, Suite: TestSuiteA, Test: TestSuiteA-TwoTestClassTest, Class: test.thread.parallelization.sample.TestClassAFiveMethodsWithFactoryUsingDataProviderAndNoDepsSample, Class instance hash code: 2084103034, Method name: testMethodB, Time of event: 2023-11-02 05:28:12.733, Thread ID: 5835}] expected [true] but found [false] at org.testng.Assert.fail(Assert.java:111) at org.testng.Assert.failNotEquals(Assert.java:1578) at org.testng.Assert.assertTrue(Assert.java:57) at test.thread.parallelization.BaseParallelizationTest.verifyEventTypeForEventsLogs(BaseParallelizationTest.java:103) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethodListenerStartEvents(BaseParallelizationTest.java:754)
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT: task ':testng-core:test'#L1
Execution failed for task ':testng-core:test': org.gradle.api.tasks.VerificationException: There were failing tests. See the report at: file:///D:/a/testng/testng/testng-core/build/reports/tests/test/index.html
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT
Execution failed for task ':testng-core:test'. > There were failing tests. See the report at: file:///D:/a/testng/testng/testng-core/build/reports/tests/test/index.html
Matrix Preparation
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
17, Zulu, ubuntu, UTC, fr_FR
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
17, Zulu, ubuntu, UTC, fr_FR
Gradle Build Scan: https://gradle.com/s/ncpu6i26zhkus
17, Zulu, ubuntu, UTC, fr_FR
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
17, Adopt Hotspot, ubuntu, UTC, de_DE, stress JIT
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
17, Adopt Hotspot, ubuntu, UTC, de_DE, stress JIT
Gradle Build Scan: https://gradle.com/s/s5snsz2koglw6
17, Adopt Hotspot, ubuntu, UTC, de_DE, stress JIT
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
11, Zulu, ubuntu, UTC, tr_TR, stress JIT
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
11, Zulu, ubuntu, UTC, tr_TR, stress JIT
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
11, Zulu, ubuntu, UTC, tr_TR, stress JIT
Gradle Build Scan: https://gradle.com/s/twm2q3dpnculc
17, Adopt Hotspot, ubuntu, UTC, ru_RU
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
17, Adopt Hotspot, ubuntu, UTC, ru_RU
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
17, Adopt Hotspot, ubuntu, UTC, ru_RU
Gradle Build Scan: https://gradle.com/s/4fuwz37mp4xfa
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU
Gradle Build Scan: https://gradle.com/s/qf5osemxaems4
17, Zulu, same hashcode, macos, Pacific/Chatham, ru_RU
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
11, Liberica, ubuntu, America/New_York, tr_TR
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
11, Liberica, ubuntu, America/New_York, tr_TR
Gradle Build Scan: https://gradle.com/s/e7ls2ezzgxdym
11, Liberica, ubuntu, America/New_York, tr_TR
distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT
distributionSha256Sum is not set in gradle\wrapper\gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT
distributionSha256Sum is not set in gradle\wrapper\gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification
11, Zulu, windows, Pacific/Chatham, tr_TR, stress JIT
Gradle Build Scan: https://gradle.com/s/xt5hnpubsg2uk

Artifacts

Produced during runtime
Name Size
build-reports-Liberica-11-1698902268 Expired
1.82 MB
build-reports-Zulu-11- Expired
1.61 MB
build-reports-Zulu-17-1698902270 Expired
1.52 MB