Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add rules to highlight infrastructure issues #3

Open
ligurio opened this issue Dec 4, 2020 · 0 comments
Open

Add rules to highlight infrastructure issues #3

ligurio opened this issue Dec 4, 2020 · 0 comments

Comments

@ligurio
Copy link
Owner

ligurio commented Dec 4, 2020

Infrastructure issues
Random incidents, like Continuous Integration (CI) node failures, network
issues, database outage etc.

Resource Leaks: https://martinfowler.com/articles/nonDeterminism.html

Remote Services: https://martinfowler.com/articles/nonDeterminism.html

Lack of Isolation: https://martinfowler.com/articles/nonDeterminism.html

https://github.com/kdeldycke/awesome-falsehood

http://xunitpatterns.com/Fragile%20Test.html

https://github.com/zulip/zulip/blob/master/tools/semgrep.yml

Selenium: https://sqa.stackexchange.com/questions/5240/are-selenium-functional-tests-reliable-enough-to-be-worthwhile

Java https://wiki.saucelabs.com/display/DOCS/How+to+Deal+with+Flaky+Java+Tests

Java, Selenium: https://habr.com/ru/company/jugru/blog/416757/

Tensorflow tensorflow/tensorflow#3103

Tensorflow https://www.twosigma.com/insights/article/a-workaround-for-non-determinism-in-tensorflow/

https://www.slideshare.net/jezhumble/creating-maintainable-automated-acceptance-tests

https://jkschin.com/2017/06/30/non-determinism.html

https://testing.googleblog.com/2009/06/my-selenium-tests-arent-stable.html

https://engineering.salesforce.com/flaky-tests-and-how-to-avoid-them-25b84b756f60

https://hackernoon.com/flaky-tests-a-war-that-never-ends-9aa32fdef359

https://www.eviltester.com/page/flaky/

https://sqa.stackexchange.com/questions/8508/what-are-anti-patterns-in-test-automation

https://sqa.stackexchange.com/questions/5240/are-selenium-functional-tests-reliable-enough-to-be-worthwhile

https://mestachs.wordpress.com/2012/08/13/selenium-best-practices/

примеры flaky кода https://www.programcreek.com/python/example/94767/flaky.flaky

тикеты на flaky тесты https://openedx.atlassian.net/browse/EDUCATOR-4134?filter=10600

Understanding Flaky Tests: The Developer’s Perspective -> "3 RQ1 – FLAKY TESTS: NATURE, ORIGIN, AND FIXING"

An Empirical Analysis of Flaky Tests

Empirical Analysis of Factors and their Effect on Test Flakiness - Practitioners’ Perceptions

Making System User Interactive Tests Repeatable: When and What Should we Control?

https://martinfowler.com/articles/nonDeterminism.html

https://schneide.blog/2019/07/22/non-determinism-in-c/

Kubernetes: https://github.com/kubernetes/community/blob/master/contributors/devel/sig-testing/flaky-tests.md#avoiding-flakes (We have a goal of 99.9% flake free tests. This means that there is only one flake in one thousand runs of a test.)

https://github.com/diy1/aspirator/tree/master/chord-src-2.1 (Simple Testing Can Prevent Most Critical Failures: An Analysis of Production Failures in Distributed Data-intensive Systems)

@ligurio ligurio closed this as completed Mar 1, 2021
@ligurio ligurio reopened this Nov 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant