Skip to content
This repository has been archived by the owner on May 7, 2021. It is now read-only.

RFE: kola should be able to run tests N times #799

Open
ajeddeloh opened this issue Jan 29, 2018 · 1 comment
Open

RFE: kola should be able to run tests N times #799

ajeddeloh opened this issue Jan 29, 2018 · 1 comment

Comments

@ajeddeloh
Copy link
Contributor

kola run should have a --number / -n flag to run the test(s) up to n times and stop on the first failure. It would also be good to utilize the parallel flag so runnning a single test can be done faster, but even a serial implementation would be nice. Furthermore a --keep-going flag could be useful to always run n tests and report the success/failure rate.

@arithx
Copy link
Contributor

arithx commented Jan 29, 2018

I think that if an implementation of the -n flag is done we'd probably want to force the --keep-going functionality if the parallel flag is given. To properly implement the stop on first failure we'd have to plumb a lot of channels through the test clusters so when we do hit a failure we can initiate a clean exit/resource cleanup while also not reporting the status.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

3 participants