Regression Tests #623
regression-tests.yml
on: schedule
Run Integration tests
5m 11s
Run API Tests
2m 33s
Run React Tests
6m 28s
E2E tests
18m 34s
Notify On Failure
6s
Annotations
10 errors, 22 warnings, and 1 notice
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression:
e2e/tests/ui-driven/src/refresh-page.spec.ts#L1
1) [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression
Test timeout of 45000ms exceeded.
|
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression:
e2e/tests/ui-driven/src/refresh-page.spec.ts#L83
1) [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression
Error: expect(locator).toBeHidden()
Locator: getByRole('link', { name: 'E2E' })
Expected: hidden
Received: visible
Call log:
- expect.toBeHidden with timeout 45000ms
- waiting for getByRole('link', { name: 'E2E' })
- locator resolved to <a href="/E2E" class="MuiTypography-root MuiTypogra…>E2E</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="MuiTypography-root MuiTypogra…>E2E</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visi
|
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression:
e2e/tests/ui-driven/src/refresh-page.spec.ts#L1
1) [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 45000ms exceeded.
|
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression:
e2e/tests/ui-driven/src/refresh-page.spec.ts#L83
1) [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toBeHidden()
Locator: getByRole('link', { name: 'E2E' })
Expected: hidden
Received: visible
Call log:
- expect.toBeHidden with timeout 45000ms
- waiting for getByRole('link', { name: 'E2E' })
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/
|
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression:
e2e/tests/ui-driven/src/refresh-page.spec.ts#L1
1) [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 45000ms exceeded.
|
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression:
e2e/tests/ui-driven/src/refresh-page.spec.ts#L83
1) [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toBeHidden()
Locator: getByRole('link', { name: 'E2E' })
Expected: hidden
Received: visible
Call log:
- expect.toBeHidden with timeout 45000ms
- waiting for getByRole('link', { name: 'E2E' })
- locator resolved to <a href="/E2E" class="MuiTypography-root MuiTypogra…>E2E</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="MuiTypography-root MuiTypogra…>E2E</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
- locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a>
- unexpected value "visible"
|
[chromium] › pay.spec.ts:52:7 › Gov Pay integration @regression › a successful payment:
e2e/tests/ui-driven/src/pay.spec.ts#L1
2) [chromium] › pay.spec.ts:52:7 › Gov Pay integration @regression › a successful payment ────────
Test timeout of 45000ms exceeded.
|
[chromium] › pay.spec.ts:52:7 › Gov Pay integration @regression › a successful payment:
e2e/tests/ui-driven/src/helpers/userActions.ts#L194
2) [chromium] › pay.spec.ts:52:7 › Gov Pay integration @regression › a successful payment ────────
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for locator('#confirm')
at helpers/userActions.ts:194
192 |
193 | export async function submitCardDetails(page: Page) {
> 194 | await page.locator("#confirm").click();
| ^
195 | }
196 |
197 | export async function answerFindProperty(page: Page) {
at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/helpers/userActions.ts:194:34)
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:61:28
|
[chromium] › pay.spec.ts:296:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment:
e2e/tests/ui-driven/src/pay.spec.ts#L1
3) [chromium] › pay.spec.ts:296:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment
Test timeout of 45000ms exceeded.
|
[chromium] › pay.spec.ts:296:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment:
e2e/tests/ui-driven/src/helpers/userActions.ts#L194
3) [chromium] › pay.spec.ts:296:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for locator('#confirm')
at helpers/userActions.ts:194
192 |
193 | export async function submitCardDetails(page: Page) {
> 194 | await page.locator("#confirm").click();
| ^
195 | }
196 |
197 | export async function answerFindProperty(page: Page) {
at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/helpers/userActions.ts:194:34)
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:307:28
|
Run API Tests
The following actions use a deprecated Node.js version and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Run API Tests:
api.planx.uk/lib/notify/index.ts#L73
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/auth/strategy/google.ts#L20
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/flows/validate/service/fileTypes.ts#L70
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.ts#L129
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.ts#L151
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L100
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L101
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L135
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L183
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L240
Unexpected any. Specify a different type
|
Run Integration tests
The following actions use a deprecated Node.js version and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Run React Tests
The following actions use a deprecated Node.js version and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L97
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L88
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L97
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L132
Unexpected use of networkidle
|
Slow Test:
e2e/tests/ui-driven/[chromium] › pay.spec.ts#L1
e2e/tests/ui-driven/[chromium] › pay.spec.ts took 2.4m
|
Slow Test:
e2e/tests/ui-driven/[chromium] › refresh-page.spec.ts#L1
e2e/tests/ui-driven/[chromium] › refresh-page.spec.ts took 2.3m
|
Slow Test:
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts#L1
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts took 1.2m
|
Slow Test:
e2e/tests/ui-driven/[chromium] › create-flow.spec.ts#L1
e2e/tests/ui-driven/[chromium] › create-flow.spec.ts took 27.4s
|
Slow Test:
e2e/tests/ui-driven/[chromium] › create-flow-with-geospatial.spec.ts#L1
e2e/tests/ui-driven/[chromium] › create-flow-with-geospatial.spec.ts took 20.5s
|
🎭 Playwright Run Summary
1 failed
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression
2 flaky
[chromium] › pay.spec.ts:52:7 › Gov Pay integration @regression › a successful payment ─────────
[chromium] › pay.spec.ts:296:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment
37 passed (7.8m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
playwright-report
|
5.07 MB |
|