Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: find optimal number of runs for fuzz/invariant tests #967

Merged
merged 1 commit into from
Oct 1, 2024

Conversation

zugdev
Copy link
Contributor

@zugdev zugdev commented Oct 1, 2024

Resolves #943

@zugdev
Copy link
Contributor Author

zugdev commented Oct 1, 2024

You can check at my fork's actions. That in branch optimal-fuzz-invariant-runs I've achieved:

Deep Fuzz (~5h30m) with 16,500,000 runs

  1. Job Run 1 - 5h 14m 03s
  2. Job Run 2 - 5h 28m 16s
  3. Job Run 3 - 5h 29m 31s
  4. Job Run 4 - 5h 30m 05s
  5. Job Run 5 - 5h 31m 02s

Invariant Tests (~5h40m) with 350,000 runs

  1. Job Run 1 - 5h 38m 49s
  2. Job Run 2 - 5h 37m 39s
  3. Job Run 3 - 5h 39m 05s
  4. Job Run 4 - 5h 39m 20s
  5. Job Run 5 - 5h 41m 10s

@zugdev zugdev marked this pull request as ready for review October 1, 2024 02:14
@zugdev zugdev requested a review from rndquu as a code owner October 1, 2024 02:14
@rndquu rndquu merged commit 6c25a2d into ubiquity:development Oct 1, 2024
12 checks passed
@ubiquity-os-deployer
Copy link

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Find optimal number of runs for fuzz/invariant tests
2 participants