Skip to content

Commit

Permalink
test: run e2e nightly tests and open issue on failure (#161)
Browse files Browse the repository at this point in the history
This pull request adds a new job to the Playwright Tests workflow that
runs e2e nightly tests. If the tests fail, it opens an issue using the
"Playwright Nightly failed" issue template. This helps to identify and
address any failures in the nightly tests.
  • Loading branch information
baruchiro authored Feb 15, 2024
1 parent 416a015 commit b22ec1e
Show file tree
Hide file tree
Showing 4 changed files with 22 additions and 4 deletions.
9 changes: 9 additions & 0 deletions .github/ISSUE_TEMPLATE/playwright-nightly-failed.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
---
title: Playwright Nightly failed
assignees: baruchiro
labels: bug
---

The tests against the real npm, pypi and Go websites failed.

Check it [here](https://github.com/os-scar/overlay/actions/workflows/playwright.yml?query=branch%3Amaster+event%3Aschedule).
13 changes: 11 additions & 2 deletions .github/workflows/playwright.yml
Original file line number Diff line number Diff line change
@@ -1,7 +1,8 @@
name: Playwright Tests
on:
push:
branches: [temp-actions]
# Schedule integration tests to see the real examples are not broken
schedule:
- cron: '0 2 * * *'
pull_request:
branches: [main, master]
merge_group:
Expand Down Expand Up @@ -32,3 +33,11 @@ jobs:
name: playwright-report
path: playwright-report/
retention-days: 30
- name: open issue
if: failure() && github.ref == 'refs/heads/master'
uses: JasonEtco/create-an-issue@v2
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
with:
update_existing: false
filename: .github/ISSUE_TEMPLATE/playwright-nighly-failed.md
2 changes: 1 addition & 1 deletion .github/workflows/real-integration.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ jobs:

steps:
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
- name: Use Node.js 18
uses: actions/setup-node@v3
with:
node-version: 18.x
Expand Down
2 changes: 1 addition & 1 deletion src/background/advisory/snyk.test.js
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ describe('snyk', () => {
},
maintenance: {
level: expect.stringMatching(/^GOOD|WARNING|BAD$/),
description: 'Sustainable',
description: 'Inactive',
},
community: {
level: expect.stringMatching(/^GOOD|WARNING|BAD$/),
Expand Down

0 comments on commit b22ec1e

Please sign in to comment.