Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bugfix: testWaitFor flakiness #100

Merged
merged 1 commit into from
Apr 5, 2024
Merged

Bugfix: testWaitFor flakiness #100

merged 1 commit into from
Apr 5, 2024

Conversation

rasberik
Copy link
Collaborator

@rasberik rasberik commented Apr 5, 2024

Pull Request Type

  • Bug fix
  • New feature
  • Refactoring
  • Documentation update
  • Chore

Description

Fixing a flaky test that was reproduced locally at (Iteration 587 of 1000). Current configuration seem to have no hard time limit, so it might be better to set time limit to decrease CI time in case of flaky tests that are stuck in await.

Main suspect of flakiness is Task with 0s sleep is executed before following await has started, meaning its value is greater than 0 already. Increasing first iteration sleep duration to any value above 0 would help to drastically decrease this flakiness.

Also increased the divider from 10 to 100, because this test's average execution time is 0.3s already, and it would increase further with 1...3.

Output

10000 iteration of tests didnt show degradation / flakiness, and average test execution duration is decreased to 0.1375 from 0.3

@rasberik rasberik requested a review from ra1028 April 5, 2024 07:16
@rasberik rasberik assigned rasberik and unassigned rasberik Apr 5, 2024
@rasberik rasberik changed the title Improve testWaitFor speed and flakiness Bugfix: testWaitFor flakiness Apr 5, 2024
@ra1028 ra1028 merged commit 019a3cc into ra1028:main Apr 5, 2024
6 checks passed
@rasberik rasberik deleted the test/fix-flaky-testWaitFor branch April 8, 2024 01:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants