Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for suite level setup and teardown #13

Open
datakurre opened this issue May 3, 2017 · 1 comment · May be fixed by #14
Open

Add support for suite level setup and teardown #13

datakurre opened this issue May 3, 2017 · 1 comment · May be fixed by #14
Assignees

Comments

@datakurre
Copy link
Contributor

Currently robotsuite run each test case in isolation and also runs robot test suite setup and teardown individually for each test case.

@datakurre
Copy link
Contributor Author

@tisto I was supposed to comment you about this issue today.

So, your wish was for a "real" support for robotframework suite level setups and teardowns so that we would not need to open Selenium test browser separately for each test case, but would keep the browser open for all tests in the same robotframework test suite. (zope.testrunner layer level browser would be even better, but unrealistic)

The main issue is that robotsuite passes the control of test execution from robotframework for zope.testrunner (or in theory some other Python unittest test runner). Robotsuite parses all tests from robotfamework test suite, passes them as individual tests for zope.testrunner and zope.testrunner runs them in order it wishes, making it hard and fragile to manage any state between tests.

For the fix, I'd suggest an environment variable controlled feature, which disables the feature described above and reports each robotframework test suite as a single unittest for zope.testrunner. The downside is that any failing test case would report the whole test suite as failing for zope.testrunner. But this might too bad, because we would still get full robotframework test report pointing the failing test case in the suite, and only difference seen with Jenkins is lower number of reported "unittests" (because of merged robotframework test cases).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant