Skip to content

Add perf tests

Add perf tests #3100

Triggered via pull request September 22, 2023 14:42
Status Failure
Total duration 6m 40s
Artifacts 1
This run and associated checks have been archived and are scheduled for deletion. Learn more about checks retention

tests.yml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 1 warning, and 1 notice
[macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form: integration-test/helpers/pages.js#L762
1) [macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form ─ Error: expect(received).toBeLessThan(expected) Expected: < 80 Received: 187 at ../helpers/pages.js:762 760 | console.log(`🏎💨 initial scan took: ${Math.round(entry.duration)}ms`) 761 | > 762 | expect(entry.duration).toBeLessThan(expectedDuration) | ^ 763 | } 764 | }) 765 | } at Object.validateInitialScanPerf (/home/runner/work/duckduckgo-autofill/duckduckgo-autofill/integration-test/helpers/pages.js:762:36)
[macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form: integration-test/tests/email-autofill.macos.spec.js#L1
1) [macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form ─ Test finished within timeout of 30000ms, but tearing down "context" ran out of time. Please allow more time for the test, since teardown is attributed towards the test timeout budget.
[macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form: integration-test/helpers/pages.js#L762
1) [macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form ─ Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toBeLessThan(expected) Expected: < 80 Received: 192 at ../helpers/pages.js:762 760 | console.log(`🏎💨 initial scan took: ${Math.round(entry.duration)}ms`) 761 | > 762 | expect(entry.duration).toBeLessThan(expectedDuration) | ^ 763 | } 764 | }) 765 | } at Object.validateInitialScanPerf (/home/runner/work/duckduckgo-autofill/duckduckgo-autofill/integration-test/helpers/pages.js:762:36)
[macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form: integration-test/tests/email-autofill.macos.spec.js#L1
1) [macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form ─ Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test finished within timeout of 30000ms, but tearing down "context" ran out of time. Please allow more time for the test, since teardown is attributed towards the test timeout budget.
[macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form: integration-test/helpers/pages.js#L762
1) [macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form ─ Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toBeLessThan(expected) Expected: < 80 Received: 152 at ../helpers/pages.js:762 760 | console.log(`🏎💨 initial scan took: ${Math.round(entry.duration)}ms`) 761 | > 762 | expect(entry.duration).toBeLessThan(expectedDuration) | ^ 763 | } 764 | }) 765 | } at Object.validateInitialScanPerf (/home/runner/work/duckduckgo-autofill/duckduckgo-autofill/integration-test/helpers/pages.js:762:36)
[macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form: integration-test/tests/email-autofill.macos.spec.js#L1
1) [macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form ─ Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Test finished within timeout of 30000ms, but tearing down "context" ran out of time. Please allow more time for the test, since teardown is attributed towards the test timeout budget.
[macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form: integration-test/helpers/pages.js#L762
1) [macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form ─ Retry #3 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toBeLessThan(expected) Expected: < 80 Received: 172 at ../helpers/pages.js:762 760 | console.log(`🏎💨 initial scan took: ${Math.round(entry.duration)}ms`) 761 | > 762 | expect(entry.duration).toBeLessThan(expectedDuration) | ^ 763 | } 764 | }) 765 | } at Object.validateInitialScanPerf (/home/runner/work/duckduckgo-autofill/duckduckgo-autofill/integration-test/helpers/pages.js:762:36)
[macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form: integration-test/tests/email-autofill.macos.spec.js#L1
1) [macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form ─ Retry #3 ─────────────────────────────────────────────────────────────────────────────────────── Test finished within timeout of 30000ms, but tearing down "context" ran out of time. Please allow more time for the test, since teardown is attributed towards the test timeout budget.
[macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form: integration-test/helpers/pages.js#L762
1) [macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form ─ Retry #4 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toBeLessThan(expected) Expected: < 80 Received: 176 at ../helpers/pages.js:762 760 | console.log(`🏎💨 initial scan took: ${Math.round(entry.duration)}ms`) 761 | > 762 | expect(entry.duration).toBeLessThan(expectedDuration) | ^ 763 | } 764 | }) 765 | } at Object.validateInitialScanPerf (/home/runner/work/duckduckgo-autofill/duckduckgo-autofill/integration-test/helpers/pages.js:762:36)
[macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form: integration-test/tests/email-autofill.macos.spec.js#L1
1) [macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form ─ Retry #4 ─────────────────────────────────────────────────────────────────────────────────────── Test finished within timeout of 30000ms, but tearing down "context" ran out of time. Please allow more time for the test, since teardown is attributed towards the test timeout budget.
test
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/cache@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
🎭 Playwright Run Summary
2 failed [macos] › email-autofill.macos.spec.js:281:9 › macos › matching performance › real-world form ── [macos] › email-autofill.macos.spec.js:304:9 › macos › matching performance › wall of 1000 fields with extreme settings 3 flaky [extension] › incontext-signup.extension.spec.js:64:5 › chrome extension › should allow tooltip to be closed [macos] › email-autofill.macos.spec.js:196:9 › macos › auto filling a signup form › with an identity + Email Protection, autofill using duck address in identity [macos] › mutating-form.macos.spec.js:19:5 › Mutating form page › works fine on macOS ────────── 99 passed (3.2m)

Artifacts

Produced during runtime
Name Size
playwright-results Expired
629 KB