-
Notifications
You must be signed in to change notification settings - Fork 16
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Randomize Unit Tests #116
Randomize Unit Tests #116
Conversation
Randomize all the specs per suite to test them in diffetnet orders of specs.
go-verify should be running prior to other targets so it verifes the dependencies in go.mod. In addition FAR will fix imports and not only test imports.
Skipping CI for Draft Pull Request. |
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: razo7 The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
/test 4.15-openshift-e2e |
Makefile
Outdated
KUBEBUILDER_ASSETS="$(shell $(ENVTEST) use $(ENVTEST_K8S_VERSION) -p path --bin-dir $(LOCALBIN))" $(GINKGO) -r --keep-going --require-suite --vv ./api/... ./pkg/... ./controllers/... --coverprofile cover.out | ||
test-no-verify: go-verify manifests generate fmt fix-imports vet envtest ginkgo ## Generate and format code, and run tests | ||
KUBEBUILDER_ASSETS="$(shell $(ENVTEST) use $(ENVTEST_K8S_VERSION) -p path --bin-dir $(LOCALBIN))" \ | ||
$(GINKGO) -r --keep-going --randomize-all --repeat=3 --require-suite --vv --coverprofile cover.out ./controllers/... ./api/... ./pkg/... |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
--repeat=3 - isn't that an overkill ?
Used for locally testing, but not needed upstream
/test 4.15-openshift-e2e |
/lgtm |
Randomize all the specs per suite to test them in diffetnet orders of specs.