Run Playwright tests against Dendrite & Pinecone periodically #3824
Annotations
8 errors, 1 warning, and 1 notice
Run Playwright tests:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L73
1) [Pinecone] › sliding-sync/sliding-sync.spec.ts:225:5 › Sliding Sync › should show and be able to accept/reject/rescind invites
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: getByRole('group', { name: 'Rooms' }).locator('.mx_RoomTile_title')
- Expected - 4
+ Received + 1
- Array [
- "Room to Join",
- "Test Room",
- ]
+ Array []
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for getByRole('group', { name: 'Rooms' }).locator('.mx_RoomTile_title')
9 × locator resolved to 0 elements
71 | test.describe("Sliding Sync", () => {
72 | const checkOrder = async (wantOrder: string[], page: Page) => {
> 73 | await expect(page.getByRole("group", { name: "Rooms" }).locator(".mx_RoomTile_title")).toHaveText(wantOrder);
| ^
74 | };
75 |
76 | const bumpRoom = async (roomId: string, app: ElementAppPage) => {
at checkOrder (/home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:73:96)
at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:270:15
|
Run Playwright tests:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L267
1) [Pinecone] › sliding-sync/sliding-sync.spec.ts:225:5 › Sliding Sync › should show and be able to accept/reject/rescind invites
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: getByRole('group', { name: 'Invites' }).locator('.mx_RoomSublist_tiles').getByRole('treeitem')
Expected: 2
Received: 0
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for getByRole('group', { name: 'Invites' }).locator('.mx_RoomSublist_tiles').getByRole('treeitem')
9 × locator resolved to 0 elements
- unexpected value "0"
265 | await expect(
266 | page.getByRole("group", { name: "Invites" }).locator(".mx_RoomSublist_tiles").getByRole("treeitem"),
> 267 | ).toHaveCount(2);
| ^
268 |
269 | // check the lists are correct
270 | await checkOrder(["Room to Join", "Test Room"], page);
at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:267:11
|
Run Playwright tests:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L73
1) [Pinecone] › sliding-sync/sliding-sync.spec.ts:225:5 › Sliding Sync › should show and be able to accept/reject/rescind invites
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: getByRole('group', { name: 'Rooms' }).locator('.mx_RoomTile_title')
- Expected - 4
+ Received + 1
- Array [
- "Room to Join",
- "Test Room",
- ]
+ Array []
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for getByRole('group', { name: 'Rooms' }).locator('.mx_RoomTile_title')
9 × locator resolved to 0 elements
71 | test.describe("Sliding Sync", () => {
72 | const checkOrder = async (wantOrder: string[], page: Page) => {
> 73 | await expect(page.getByRole("group", { name: "Rooms" }).locator(".mx_RoomTile_title")).toHaveText(wantOrder);
| ^
74 | };
75 |
76 | const bumpRoom = async (roomId: string, app: ElementAppPage) => {
at checkOrder (/home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:73:96)
at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:270:15
|
Run Playwright tests:
playwright/e2e/settings/preferences-user-settings-tab.spec.ts#L1
2) [Pinecone] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot
Test timeout of 30000ms exceeded while setting up "user".
|
Run Playwright tests:
playwright/element-web-test.ts#L183
2) [Pinecone] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot
Error: page.waitForSelector: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_MatrixChat') to be visible
at ../element-web-test.ts:183
181 | user: async ({ pageWithCredentials: page, credentials }, use) => {
182 | await page.goto("/");
> 183 | await page.waitForSelector(".mx_MatrixChat", { timeout: 30000 });
| ^
184 | await use(credentials);
185 | },
186 |
at Object.user (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:183:20)
|
Run Playwright tests:
playwright/element-web-test.ts#L315
3) [Pinecone] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot
Error: expect.toMatchScreenshot: Test ended.
at ../element-web-test.ts:315
313 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options);
314 |
> 315 | await style.evaluate((tag) => tag.remove());
| ^
316 |
317 | testInfo.annotations.push({
318 | // `_` prefix hides it from the HTML reporter
at Object.toMatchScreenshot (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:315:21)
|
Run Playwright tests:
playwright/element-web-test.ts#L308
4) [Pinecone] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot
Error: expect.toMatchScreenshot: Test ended.
at ../element-web-test.ts:308
306 |
307 | // We add a custom style tag before taking screenshots
> 308 | const style = (await page.addStyleTag({
| ^
309 | content: css,
310 | })) as ElementHandle<Element>;
311 |
at Object.toMatchScreenshot (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:308:35)
at /home/runner/work/element-web/element-web/playwright/e2e/share-dialog/share-dialog.spec.ts:43:24
|
Run Playwright tests
Process completed with exit code 1.
|
Run Playwright tests:
[Pinecone] › settings/general-room-settings-tab.spec.ts#L1
[Pinecone] › settings/general-room-settings-tab.spec.ts took 15.8s
|
Run Playwright tests
1 failed
[Pinecone] › sliding-sync/sliding-sync.spec.ts:225:5 › Sliding Sync › should show and be able to accept/reject/rescind invites
3 flaky
[Pinecone] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot
[Pinecone] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot
[Pinecone] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot
34 skipped
18 passed (3.9m)
|
Loading