Automatic failing/non-execution of interdependent tests in Robot Framework

by

Robot is very extensible, and a feature that was introduced in version 2.8.5 makes it easy to write a keyword that will fail if another test has failed. This feature is the ability for a library to act as a listener. With this, a library can keep track of the pass/fail status of each test. With that knowledge, you can create a keyword that fails immediately if some other test fails.

The basic idea is, cache the pass/fail status as each test finishes (via the special _end_test method). Then, use this value to determine whether to fail immediately or not.

Here’s an example of how to use such a keyword:

*** Settings ***
Library   /path/to/DependencyLibrary.py

*** Test Cases ***
Example of a failing test
    fail  this test has failed

Example of a dependent test
    [Setup] | Require test case | Example of a failing test
    log | hello, world

Here is the library definition:

from robot.libraries.BuiltIn import BuiltIn

class DependencyLibrary(object):
    ROBOT_LISTENER_API_VERSION = 2
    ROBOT_LIBRARY_SCOPE = "GLOBAL"

    def __init__(self):
        self.ROBOT_LIBRARY_LISTENER = self
        self.test_status = {}

    def require_test_case(self, name):
        key = name.lower()
        if (key not in self.test_status):
            BuiltIn().fail("required test case can't be found: '%s'" % name)
            
        if (self.test_status[key] != "PASS"):
            BuiltIn().fail("required test case failed: '%s'" % name)

        return True

    def _end_test(self, name, attrs):
        self.test_status[name.lower()] = attrs["status"]

More Related Contents:

  1. Python Selenium wait for several elements to load
  2. How can I scroll a web page using selenium webdriver in python?
  3. Get HTML source of WebElement in Selenium WebDriver using Python
  4. How can I time a code segment for testing performance with Pythons timeit?
  5. How to upload file ( picture ) with selenium, python
  6. Running Selenium WebDriver python bindings in chrome
  7. Trying to mock datetime.date.today(), but not working
  8. Selenium waitForElement
  9. How to pass arguments in pytest by command line
  10. How to properly assert that an exception gets raised in pytest?
  11. Select -> option abstraction
  12. Expected conditions in protractor
  13. How do I run all Python unit tests in a directory?
  14. python: how to send mail with TO, CC and BCC?
  15. How to test a function with input call?
  16. Python unit test with base and sub class
  17. How to skip the rest of tests in the class if one has failed?
  18. Pass existing Webdriver object to custom Python library for Robot Framework
  19. Re-read an open file Python
  20. How can one mock/stub python module like urllib
  21. Mock attributes in Python mock?
  22. how to test if one python module has been imported?
  23. How to test or mock “if __name__ == ‘__main__'” contents
  24. Accurate timing of functions in python
  25. Invoking Pylint programmatically
  26. how to share a variable across modules for all tests in py.test
  27. Practicing BDD with python [closed]
  28. Unit testing a python app that uses the requests library
  29. Python – Testing an abstract base class
  30. Unknown error: Chrome failed to start: exited abnormally

Leave a Comment