-
-
Notifications
You must be signed in to change notification settings - Fork 76
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Workflows: Add scheduled e2e step and refactor ENV vars #2059
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #2059 +/- ##
==========================================
- Coverage 74.88% 74.38% -0.51%
==========================================
Files 41 41
Lines 3146 3146
Branches 689 689
==========================================
- Hits 2356 2340 -16
- Misses 671 686 +15
- Partials 119 120 +1 ☔ View full report in Codecov by Sentry. |
@audiodude I'm good with this, but I see no value to remove testing e2e on PR. I think this is an error and unit testing coverage is really not that good. If a PR CI fails because of one of the e2e tests, then we should fix the e2e test first, I'm even ready to accept if this is in the current PR. If the PR is urgent, then we can event exceptionally shortcut the CI. |
If you look at the code:
The target However, the decision to only run the e2e tests on a schedule is probably flawed due to #2057. We should probably run all tests on the schedule, because many (most?) of the "unit" tests are actually e2e tests. |
d991c00
to
4acabb7
Compare
I've updated the PR to run all tests on the schedule (without coverage). PTAL. I've also renamed 'build' to 'ci-test' because it's not a build, it's running the CI tests. Note: One thing I ran into when researching this PR is that schedule build notification emails will only get sent to me (or in the future, the last person who committed a change to |
FIxes #2058
This PR refactors the
ci.yml
file to introduce a workflow step that only runs when the workflow is triggered by cron/scheduled. If the workflow is not triggered by cron (eg by PR), thetest:e2e
target is not run. So, alternately, when the workflow is triggered by a PR, the normal tests, with coverage, are run instead.