Skip to content

Regression Tests

Regression Tests #623

Triggered via schedule October 9, 2024 06:03
Status Failure
Total duration 18m 57s
Artifacts 1

regression-tests.yml

on: schedule
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 22 warnings, and 1 notice
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression: e2e/tests/ui-driven/src/refresh-page.spec.ts#L1
1) [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression Test timeout of 45000ms exceeded.
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression: e2e/tests/ui-driven/src/refresh-page.spec.ts#L83
1) [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression Error: expect(locator).toBeHidden() Locator: getByRole('link', { name: 'E2E' }) Expected: hidden Received: visible Call log: - expect.toBeHidden with timeout 45000ms - waiting for getByRole('link', { name: 'E2E' }) - locator resolved to <a href="/E2E" class="MuiTypography-root MuiTypogra…>E2E</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="MuiTypography-root MuiTypogra…>E2E</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visi
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression: e2e/tests/ui-driven/src/refresh-page.spec.ts#L1
1) [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 45000ms exceeded.
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression: e2e/tests/ui-driven/src/refresh-page.spec.ts#L83
1) [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toBeHidden() Locator: getByRole('link', { name: 'E2E' }) Expected: hidden Received: visible Call log: - expect.toBeHidden with timeout 45000ms - waiting for getByRole('link', { name: 'E2E' }) - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression: e2e/tests/ui-driven/src/refresh-page.spec.ts#L1
1) [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 45000ms exceeded.
[chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression: e2e/tests/ui-driven/src/refresh-page.spec.ts#L83
1) [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toBeHidden() Locator: getByRole('link', { name: 'E2E' }) Expected: hidden Received: visible Call log: - expect.toBeHidden with timeout 45000ms - waiting for getByRole('link', { name: 'E2E' }) - locator resolved to <a href="/E2E" class="MuiTypography-root MuiTypogra…>E2E</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="MuiTypography-root MuiTypogra…>E2E</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible" - locator resolved to <a href="/E2E" class="css-1hr8cts ">…</a> - unexpected value "visible"
[chromium] › pay.spec.ts:52:7 › Gov Pay integration @regression › a successful payment: e2e/tests/ui-driven/src/pay.spec.ts#L1
2) [chromium] › pay.spec.ts:52:7 › Gov Pay integration @regression › a successful payment ──────── Test timeout of 45000ms exceeded.
[chromium] › pay.spec.ts:52:7 › Gov Pay integration @regression › a successful payment: e2e/tests/ui-driven/src/helpers/userActions.ts#L194
2) [chromium] › pay.spec.ts:52:7 › Gov Pay integration @regression › a successful payment ──────── Error: locator.click: Test timeout of 45000ms exceeded. Call log: - waiting for locator('#confirm') at helpers/userActions.ts:194 192 | 193 | export async function submitCardDetails(page: Page) { > 194 | await page.locator("#confirm").click(); | ^ 195 | } 196 | 197 | export async function answerFindProperty(page: Page) { at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/helpers/userActions.ts:194:34) at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:61:28
[chromium] › pay.spec.ts:296:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment: e2e/tests/ui-driven/src/pay.spec.ts#L1
3) [chromium] › pay.spec.ts:296:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment Test timeout of 45000ms exceeded.
[chromium] › pay.spec.ts:296:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment: e2e/tests/ui-driven/src/helpers/userActions.ts#L194
3) [chromium] › pay.spec.ts:296:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment Error: locator.click: Test timeout of 45000ms exceeded. Call log: - waiting for locator('#confirm') at helpers/userActions.ts:194 192 | 193 | export async function submitCardDetails(page: Page) { > 194 | await page.locator("#confirm").click(); | ^ 195 | } 196 | 197 | export async function answerFindProperty(page: Page) { at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/helpers/userActions.ts:194:34) at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:307:28
Run API Tests
The following actions use a deprecated Node.js version and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run API Tests: api.planx.uk/lib/notify/index.ts#L73
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/auth/strategy/google.ts#L20
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/flows/validate/service/fileTypes.ts#L70
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/classifiedRoads.ts#L129
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/classifiedRoads.ts#L151
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L100
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L101
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L135
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L183
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L240
Unexpected any. Specify a different type
Run Integration tests
The following actions use a deprecated Node.js version and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run React Tests
The following actions use a deprecated Node.js version and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
E2E tests: e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L97
Unexpected use of networkidle
E2E tests: e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L88
Unexpected use of networkidle
E2E tests: e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L97
Unexpected use of networkidle
E2E tests: e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L132
Unexpected use of networkidle
Slow Test: e2e/tests/ui-driven/[chromium] › pay.spec.ts#L1
e2e/tests/ui-driven/[chromium] › pay.spec.ts took 2.4m
Slow Test: e2e/tests/ui-driven/[chromium] › refresh-page.spec.ts#L1
e2e/tests/ui-driven/[chromium] › refresh-page.spec.ts took 2.3m
Slow Test: e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts#L1
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts took 1.2m
Slow Test: e2e/tests/ui-driven/[chromium] › create-flow.spec.ts#L1
e2e/tests/ui-driven/[chromium] › create-flow.spec.ts took 27.4s
Slow Test: e2e/tests/ui-driven/[chromium] › create-flow-with-geospatial.spec.ts#L1
e2e/tests/ui-driven/[chromium] › create-flow-with-geospatial.spec.ts took 20.5s
🎭 Playwright Run Summary
1 failed [chromium] › refresh-page.spec.ts:62:7 › Refresh page › team data persists on page refresh @regression 2 flaky [chromium] › pay.spec.ts:52:7 › Gov Pay integration @regression › a successful payment ───────── [chromium] › pay.spec.ts:296:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment 37 passed (7.8m)

Artifacts

Produced during runtime
Name Size
playwright-report
5.07 MB