End to End Tests #3836
Annotations
16 errors, 30 warnings, and 6 notices
[Chrome] › integration-manager/read_events.spec.ts:149:9 › Integration Manager: Read Events › should read a state event with empty state key:
playwright/e2e/integration-manager/read_events.spec.ts#L99
1) [Chrome] › integration-manager/read_events.spec.ts:149:9 › Integration Manager: Read Events › should read a state event with empty state key
Test timeout of 30000ms exceeded while running "beforeEach" hook.
97 | });
98 |
> 99 | test.beforeEach(async ({ page, user, app, room }) => {
| ^
100 | await app.client.setAccountData("m.widgets", {
101 | "m.integration_manager": {
102 | content: {
at /home/runner/work/element-web/element-web/playwright/e2e/integration-manager/read_events.spec.ts:99:10
|
[Chrome] › integration-manager/read_events.spec.ts:149:9 › Integration Manager: Read Events › should read a state event with empty state key:
playwright/pages/ElementAppPage.ts#L96
1) [Chrome] › integration-manager/read_events.spec.ts:149:9 › Integration Manager: Read Events › should read a state event with empty state key
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByRole('tree', { name: 'Rooms' }).locator('[title="Integration Manager Test"],[aria-label="Integration Manager Test"]').first()
at ../pages/ElementAppPage.ts:96
94 | .locator(`[title="${name}"],[aria-label="${name}"]`)
95 | .first()
> 96 | .click();
| ^
97 | }
98 |
99 | public async viewRoomById(roomId: string): Promise<void> {
at ElementAppPage.viewRoomByName (/home/runner/work/element-web/element-web/playwright/pages/ElementAppPage.ts:96:14)
at /home/runner/work/element-web/element-web/playwright/e2e/integration-manager/read_events.spec.ts:126:19
|
[Chrome] › sliding-sync/sliding-sync.spec.ts:366:5 › Sliding Sync › should send unsubscribe_rooms for every room switch:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L383
1) [Chrome] › sliding-sync/sliding-sync.spec.ts:366:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
Error: expect(received).not.toHaveProperty(path)
Matcher error: received value must not be null nor undefined
Received has value: undefined
381 | }
382 | expect(body.unsubscribe_rooms).toEqual([unsubRoomId]);
> 383 | expect(body.room_subscriptions).not.toHaveProperty(unsubRoomId);
| ^
384 | expect(body.room_subscriptions).toHaveProperty(subRoomId);
385 | };
386 |
at assertUnsubExists (/home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:383:49)
at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:404:9
|
[Chrome] › sliding-sync/sliding-sync.spec.ts:366:5 › Sliding Sync › should send unsubscribe_rooms for every room switch:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L382
1) [Chrome] › sliding-sync/sliding-sync.spec.ts:366:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toEqual(expected) // deep equality
Expected: ["!MPRabjwyhrgLHDYYam:localhost"]
Received: undefined
380 | return;
381 | }
> 382 | expect(body.unsubscribe_rooms).toEqual([unsubRoomId]);
| ^
383 | expect(body.room_subscriptions).not.toHaveProperty(unsubRoomId);
384 | expect(body.room_subscriptions).toHaveProperty(subRoomId);
385 | };
at assertUnsubExists (/home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:382:44)
at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:404:9
|
[Chrome] › sliding-sync/sliding-sync.spec.ts:366:5 › Sliding Sync › should send unsubscribe_rooms for every room switch:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L382
1) [Chrome] › sliding-sync/sliding-sync.spec.ts:366:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toEqual(expected) // deep equality
Expected: ["!DhusOmjehqInAzgZrR:localhost"]
Received: undefined
380 | return;
381 | }
> 382 | expect(body.unsubscribe_rooms).toEqual([unsubRoomId]);
| ^
383 | expect(body.room_subscriptions).not.toHaveProperty(unsubRoomId);
384 | expect(body.room_subscriptions).toHaveProperty(subRoomId);
385 | };
at assertUnsubExists (/home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:382:44)
at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:404:9
|
[Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread:
playwright/e2e/room_options/marked_unread.spec.ts#L51
2) [Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread
Error: expect(locator).toBeVisible()
Locator: getByLabel('The mark unread test room Unread messages.')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByLabel('The mark unread test room Unread messages.')
49 | await page.getByRole("menuitem", { name: "Mark as unread" }).click();
50 |
> 51 | expect(page.getByLabel(TEST_ROOM_NAME + " Unread messages.")).toBeVisible();
| ^
52 | });
53 | });
54 |
at /home/runner/work/element-web/element-web/playwright/e2e/room_options/marked_unread.spec.ts:51:71
|
[Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory @no-webkit:
playwright/e2e/room-directory/room-directory.spec.ts#L34
3) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory @no-webkit
Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected)
Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost')
Expected string: "mx_EditableItem_item"
Received: <element(s) not found>
Call log:
- expect.toHaveClass with timeout 5000ms
- waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost')
32 | await localAddresses.getByRole("textbox").fill("gaming");
33 | await localAddresses.getByRole("button", { name: "Add" }).click();
> 34 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item");
| ^
35 |
36 | // Publish into the public rooms directory
37 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" });
at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:34:73
|
[Chrome] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot:
playwright/element-web-test.ts#L313
4) [Chrome] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot
Error: expect.toHaveScreenshot(share-dialog-room.png): Test ended.
Call log:
- expect.toHaveScreenshot(share-dialog-room.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByRole('dialog', { name: 'Share room' })
at ../element-web-test.ts:313
311 |
312 | const screenshotName = sanitizeFilePathBeforeExtension(name);
> 313 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options);
| ^
314 |
315 | await style.evaluate((tag) => tag.remove());
316 |
at Object.toMatchScreenshot (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:313:9)
|
[Chrome] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot:
playwright/element-web-test.ts#L313
5) [Chrome] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot
Error: expect.toHaveScreenshot(share-dialog-user.png): Test ended.
Call log:
- expect.toHaveScreenshot(share-dialog-user.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByRole('dialog', { name: 'Share User' })
at ../element-web-test.ts:313
311 |
312 | const screenshotName = sanitizeFilePathBeforeExtension(name);
> 313 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options);
| ^
314 |
315 | await style.evaluate((tag) => tag.remove());
316 |
at Object.toMatchScreenshot (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:313:9)
|
[Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot:
playwright/element-web-test.ts#L313
6) [Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot
Error: expect.toHaveScreenshot(share-dialog-event.png): Test ended.
Call log:
- expect.toHaveScreenshot(share-dialog-event.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByRole('dialog', { name: 'Share Room Message' })
- locator resolved to <div role="dialog" class="mx_ShareDialog" data-focus-lock-disabled="false" aria-describedby="mx_Dialog_content" aria-labelledby="mx_BaseDialog_title">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
at ../element-web-test.ts:313
311 |
312 | const screenshotName = sanitizeFilePathBeforeExtension(name);
> 313 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options);
| ^
314 |
315 | await style.evaluate((tag) => tag.remove());
316 |
at Object.toMatchScreenshot (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:313:9)
|
Run Tests [Chrome] 5/6
Process completed with exit code 1.
|
[Chrome] › audio-player/audio-player.spec.ts:152:9 › Audio player › should be correctly rendered - high contrast theme @no-firefox @no-webkit @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L125
1) [Chrome] › audio-player/audio-player.spec.ts:152:9 › Audio player › should be correctly rendered - high contrast theme @no-firefox @no-webkit @screenshot
Test timeout of 30000ms exceeded while running "beforeEach" hook.
123 | };
124 |
> 125 | test.beforeEach(async ({ page, app, user }) => {
| ^
126 | await app.client.createRoom({ name: "Test Room" });
127 | await app.viewRoomByName("Test Room");
128 |
at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:125:10
|
[Chrome] › audio-player/audio-player.spec.ts:152:9 › Audio player › should be correctly rendered - high contrast theme @no-firefox @no-webkit @screenshot:
playwright/pages/ElementAppPage.ts#L96
1) [Chrome] › audio-player/audio-player.spec.ts:152:9 › Audio player › should be correctly rendered - high contrast theme @no-firefox @no-webkit @screenshot
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByRole('tree', { name: 'Rooms' }).locator('[title="Test Room"],[aria-label="Test Room"]').first()
at ../pages/ElementAppPage.ts:96
94 | .locator(`[title="${name}"],[aria-label="${name}"]`)
95 | .first()
> 96 | .click();
| ^
97 | }
98 |
99 | public async viewRoomById(roomId: string): Promise<void> {
at ElementAppPage.viewRoomByName (/home/runner/work/element-web/element-web/playwright/pages/ElementAppPage.ts:96:14)
at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:127:19
|
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L1
2) [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
Test timeout of 30000ms exceeded.
|
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L257
2) [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_EventTile_last').getByRole('button', { name: 'Reply', exact: true })
255 | const clickButtonReply = async () => {
256 | await tile.hover();
> 257 | await tile.getByRole("button", { name: "Reply", exact: true }).click();
| ^
258 | };
259 |
260 | await uploadFile(page, "playwright/sample-files/upload-first.ogg");
at clickButtonReply (/home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:257:80)
at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:273:13
|
end-to-end-tests
Process completed with exit code 1.
|
Slow Test:
[Chrome] › read-receipts/high-level.spec.ts#L1
[Chrome] › read-receipts/high-level.spec.ts took 3.2m
|
Slow Test:
[Chrome] › read-receipts/new-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/new-messages-in-threads.spec.ts took 1.6m
|
Slow Test:
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts took 1.2m
|
Slow Test:
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts took 1.1m
|
Slow Test:
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts took 1.1m
|
Slow Test:
[Chrome] › read-receipts/redactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/redactions-in-threads.spec.ts took 2.5m
|
Slow Test:
[Chrome] › read-receipts/redactions-main-timeline.spec.ts#L1
[Chrome] › read-receipts/redactions-main-timeline.spec.ts took 1.9m
|
Slow Test:
[Chrome] › read-receipts/read-receipts.spec.ts#L1
[Chrome] › read-receipts/read-receipts.spec.ts took 1.1m
|
Slow Test:
[Chrome] › read-receipts/reactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/reactions-in-threads.spec.ts took 57.0s
|
Slow Test:
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts took 55.0s
|
Slow Test:
[Chrome] › timeline/timeline.spec.ts#L1
[Chrome] › timeline/timeline.spec.ts took 2.6m
|
Slow Test:
[Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.2m
|
Slow Test:
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m
|
Slow Test:
[Chrome] › user-onboarding/user-onboarding-new.spec.ts#L1
[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 34.7s
|
Slow Test:
[Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 33.3s
|
Slow Test:
[Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 2.2m
|
Slow Test:
[Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 1.7m
|
Slow Test:
[Chrome] › login/login.spec.ts#L1
[Chrome] › login/login.spec.ts took 1.1m
|
Slow Test:
[Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 37.1s
|
Slow Test:
[Chrome] › polls/polls.spec.ts#L1
[Chrome] › polls/polls.spec.ts took 33.5s
|
Slow Test:
[Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 1.0m
|
Slow Test:
[Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 53.0s
|
Slow Test:
[Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 42.6s
|
Slow Test:
[Chrome] › right-panel/file-panel.spec.ts#L1
[Chrome] › right-panel/file-panel.spec.ts took 37.3s
|
Slow Test:
[Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts#L1
[Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 30.4s
|
Slow Test:
[Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 1.2m
|
Slow Test:
[Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 1.2m
|
Slow Test:
[Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 1.0m
|
Slow Test:
[Chrome] › crypto/backups.spec.ts#L1
[Chrome] › crypto/backups.spec.ts took 58.3s
|
Slow Test:
[Chrome] › crypto/device-verification.spec.ts#L1
[Chrome] › crypto/device-verification.spec.ts took 42.7s
|
🎭 Playwright Run Summary
32 skipped
50 passed (9.4m)
|
🎭 Playwright Run Summary
15 skipped
60 passed (9.4m)
|
🎭 Playwright Run Summary
3 skipped
69 passed (9.5m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › integration-manager/read_events.spec.ts:149:9 › Integration Manager: Read Events › should read a state event with empty state key
1 skipped
76 passed (10.9m)
|
🎭 Playwright Run Summary
1 failed
[Chrome] › sliding-sync/sliding-sync.spec.ts:366:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
5 flaky
[Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread
[Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory @no-webkit
[Chrome] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot
[Chrome] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot
[Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot
1 skipped
73 passed (11.8m)
|
🎭 Playwright Run Summary
2 flaky
[Chrome] › audio-player/audio-player.spec.ts:152:9 › Audio player › should be correctly rendered - high contrast theme @no-firefox @no-webkit @screenshot
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
80 passed (13.1m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-Chrome-1
Expired
|
10.3 MB |
|
all-blob-reports-Chrome-2
Expired
|
3.98 MB |
|
all-blob-reports-Chrome-3
Expired
|
294 KB |
|
all-blob-reports-Chrome-4
Expired
|
308 KB |
|
all-blob-reports-Chrome-5
Expired
|
23.5 MB |
|
all-blob-reports-Chrome-6
Expired
|
1.03 MB |
|
html-report
|
34.1 MB |
|
webapp
Expired
|
28.5 MB |
|