Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regression pipeline #23

Open
woodruffw opened this issue Jan 6, 2020 · 0 comments
Open

Regression pipeline #23

woodruffw opened this issue Jan 6, 2020 · 0 comments
Labels
C:tests enhancement New feature or request

Comments

@woodruffw
Copy link
Member

Now that we have CI configured and automated submodule updates via Dependabot, it'd be interesting to hack together some kind of basic regression testing for our implemented workers. Something like this:

  1. We run the mishegos for a few hours to generate a decently sized corpus
  2. We run that corpus through our analysis passes to filter out true positives and negatives
  3. We save the filtered corpus somewhere (cloud storage?)
  4. On each Dependabot PR, we perform additional CI jobs to see if any of our results have changed
@woodruffw woodruffw added enhancement New feature or request C:tests labels Jan 6, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C:tests enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant