-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
reporting for retries #75
Comments
@SabotageAndi how do you do this in Specflow :D Care to offer a quick win :) |
We're not making any more changes to the JSON formatter, but this could be implemented in https://github.com/cucumber/common/tree/main/react/javascript#readme Shall we move this issue to |
I think the messages would have all the info for all messages-based formatters to be enhanced too But first, let's focus on the html-formatter |
Noting here that |
Is your feature request related to a problem? Please describe.
Cucumber report(html, json formatter) doesn't include retried details when using
--retry
.When we use
--retry
, report will mark the flaky test pass if there is one retry get pass. That is working as expected. However, if we can also add some details ofretry
in the report, e.g show the number of failed attempt, that will help us to find potential intermittent bugs, instead of hiding bugs.The idea is coming from https://automationpanda.com/2021/06/14/are-automated-test-retries-good-or-bad/
Describe the solution you'd like
Something on the report to indicate there are retry attempts happened. Like the number of failed attempt. A example:
The text was updated successfully, but these errors were encountered: