We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Infrastructure issues Random incidents, like Continuous Integration (CI) node failures, network issues, database outage etc.
Resource Leaks: https://martinfowler.com/articles/nonDeterminism.html
Remote Services: https://martinfowler.com/articles/nonDeterminism.html
Lack of Isolation: https://martinfowler.com/articles/nonDeterminism.html
https://github.com/kdeldycke/awesome-falsehood
http://xunitpatterns.com/Fragile%20Test.html
https://github.com/zulip/zulip/blob/master/tools/semgrep.yml
Selenium: https://sqa.stackexchange.com/questions/5240/are-selenium-functional-tests-reliable-enough-to-be-worthwhile
Java https://wiki.saucelabs.com/display/DOCS/How+to+Deal+with+Flaky+Java+Tests
Java, Selenium: https://habr.com/ru/company/jugru/blog/416757/
Tensorflow tensorflow/tensorflow#3103
Tensorflow https://www.twosigma.com/insights/article/a-workaround-for-non-determinism-in-tensorflow/
https://www.slideshare.net/jezhumble/creating-maintainable-automated-acceptance-tests
https://jkschin.com/2017/06/30/non-determinism.html
https://testing.googleblog.com/2009/06/my-selenium-tests-arent-stable.html
https://engineering.salesforce.com/flaky-tests-and-how-to-avoid-them-25b84b756f60
https://hackernoon.com/flaky-tests-a-war-that-never-ends-9aa32fdef359
https://www.eviltester.com/page/flaky/
https://sqa.stackexchange.com/questions/8508/what-are-anti-patterns-in-test-automation
https://sqa.stackexchange.com/questions/5240/are-selenium-functional-tests-reliable-enough-to-be-worthwhile
https://mestachs.wordpress.com/2012/08/13/selenium-best-practices/
примеры flaky кода https://www.programcreek.com/python/example/94767/flaky.flaky
тикеты на flaky тесты https://openedx.atlassian.net/browse/EDUCATOR-4134?filter=10600
Understanding Flaky Tests: The Developer’s Perspective -> "3 RQ1 – FLAKY TESTS: NATURE, ORIGIN, AND FIXING"
An Empirical Analysis of Flaky Tests
Empirical Analysis of Factors and their Effect on Test Flakiness - Practitioners’ Perceptions
Making System User Interactive Tests Repeatable: When and What Should we Control?
https://martinfowler.com/articles/nonDeterminism.html
https://schneide.blog/2019/07/22/non-determinism-in-c/
Kubernetes: https://github.com/kubernetes/community/blob/master/contributors/devel/sig-testing/flaky-tests.md#avoiding-flakes (We have a goal of 99.9% flake free tests. This means that there is only one flake in one thousand runs of a test.)
https://github.com/diy1/aspirator/tree/master/chord-src-2.1 (Simple Testing Can Prevent Most Critical Failures: An Analysis of Production Failures in Distributed Data-intensive Systems)
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Infrastructure issues
Random incidents, like Continuous Integration (CI) node failures, network
issues, database outage etc.
Resource Leaks: https://martinfowler.com/articles/nonDeterminism.html
Remote Services: https://martinfowler.com/articles/nonDeterminism.html
Lack of Isolation: https://martinfowler.com/articles/nonDeterminism.html
https://github.com/kdeldycke/awesome-falsehood
http://xunitpatterns.com/Fragile%20Test.html
https://github.com/zulip/zulip/blob/master/tools/semgrep.yml
Selenium: https://sqa.stackexchange.com/questions/5240/are-selenium-functional-tests-reliable-enough-to-be-worthwhile
Java https://wiki.saucelabs.com/display/DOCS/How+to+Deal+with+Flaky+Java+Tests
Java, Selenium: https://habr.com/ru/company/jugru/blog/416757/
Tensorflow tensorflow/tensorflow#3103
Tensorflow https://www.twosigma.com/insights/article/a-workaround-for-non-determinism-in-tensorflow/
https://www.slideshare.net/jezhumble/creating-maintainable-automated-acceptance-tests
https://jkschin.com/2017/06/30/non-determinism.html
https://testing.googleblog.com/2009/06/my-selenium-tests-arent-stable.html
https://engineering.salesforce.com/flaky-tests-and-how-to-avoid-them-25b84b756f60
https://hackernoon.com/flaky-tests-a-war-that-never-ends-9aa32fdef359
https://www.eviltester.com/page/flaky/
https://sqa.stackexchange.com/questions/8508/what-are-anti-patterns-in-test-automation
https://sqa.stackexchange.com/questions/5240/are-selenium-functional-tests-reliable-enough-to-be-worthwhile
https://mestachs.wordpress.com/2012/08/13/selenium-best-practices/
примеры flaky кода https://www.programcreek.com/python/example/94767/flaky.flaky
тикеты на flaky тесты https://openedx.atlassian.net/browse/EDUCATOR-4134?filter=10600
Understanding Flaky Tests: The Developer’s Perspective -> "3 RQ1 – FLAKY TESTS: NATURE, ORIGIN, AND FIXING"
An Empirical Analysis of Flaky Tests
Empirical Analysis of Factors and their Effect on Test Flakiness - Practitioners’ Perceptions
Making System User Interactive Tests Repeatable: When and What Should we Control?
https://martinfowler.com/articles/nonDeterminism.html
https://schneide.blog/2019/07/22/non-determinism-in-c/
Kubernetes: https://github.com/kubernetes/community/blob/master/contributors/devel/sig-testing/flaky-tests.md#avoiding-flakes (We have a goal of 99.9% flake free tests. This means that there is only one flake in one thousand runs of a test.)
https://github.com/diy1/aspirator/tree/master/chord-src-2.1 (Simple Testing Can Prevent Most Critical Failures: An Analysis of Production Failures in Distributed Data-intensive Systems)
The text was updated successfully, but these errors were encountered: