Has JUnit4 begun supporting ordering of test? Is it intentional?

by

No JUnit does not support test ordering, except in the manner that you say, through Suite.
This only defines the order in which the test classes are executed. This has been there for a long time, including JUnit 3 Suite classes.

For a more complete explanation, there are three things we need to talk about here:

  1. the ordering of tests classes within a test suite
  2. the ordering of test classes when they are found by reflection by Eclipse or Maven
  3. the ordering of test methods (annotated with @Test) within a test class.

The ordering of tests classes within a test suite

When you specify the list of classes to be executed in a test suite, you’re defining an array, and these test classes will be executed in order, except when you’re doing parallel execution. Unfortunately, this allows the introduction of dependencies between your test classes.

The ordering of test classes when they are found by reflection

When searching the classpath for classes, the order in which they are found is not guaranteed, so cannot be depended upon. It isn’t actually JUnit which is doing the searching, but the Eclipse Junit plugin, or maven surefire or failsafe.

The ordering of test methods within a test class

JUnit does not guarantee the order of execution of tests within a class. Most of the time, on most JVMs pre version 7, the order in which they are found using reflection is in declaration order, ie the order they are in the file. This is the order in which they are executed. However, with JVM 7, this is no longer guaranteed, so there won’t be a consistent order. There is a github issue #293 Sort test methods for predictability open with suggested solutions, and there is a thread on the junit mailing list: Alphabetizing test method run order?. So you cannot depend upon the order that tests will be executed using JUnit, but this is currently under discussion.

More Related Contents:

  1. How do you assert that a certain exception is thrown in JUnit 4 tests?
  2. Difference between @Before, @BeforeClass, @BeforeEach and @BeforeAll
  3. How to run test methods in specific order in JUnit4?
  4. How do you assert that a certain exception is thrown in JUnit tests?
  5. Getting “NoSuchMethodError: org.hamcrest.Matcher.describeMismatch” when running test in IntelliJ 10.5
  6. Changing names of parameterized tests
  7. How to test that no exception is thrown?
  8. No tests found with test runner ‘JUnit 4’
  9. How do I Dynamically create a Test Suite in JUnit 4?
  10. How to run all tests belonging to a certain Category in JUnit 4
  11. How does Junit @Rule work?
  12. Is Java’s assertEquals method reliable?
  13. java.lang.Exception: No runnable methods exception in running JUnits
  14. How to define a JUnit method rule in a test suite?
  15. differences between 2 JUnit Assert classes
  16. How to run all JUnit tests in a category/suite with Ant?
  17. Why is assertEquals(double,double) deprecated in JUnit?
  18. setUp/tearDown (@Before/@After) why we need them in JUnit?
  19. JUnit 4 @BeforeClass & @AfterClass when using Suites
  20. Does Junit reinitialize the class with each test method invocation?
  21. How to do a JUnit assert on a message in a logger
  22. @RunWith(MockitoJUnitRunner.class) vs MockitoAnnotations.initMocks(this)
  23. JUnit 4 Test Suites
  24. How to tell a Mockito mock object to return something different the next time it is called?
  25. Mockito: Mock private field initialization
  26. Location of spring-context.xml
  27. Why are my mocked methods not calld when executing a unit test?
  28. cucumber throwing java.lang.NoClassDefFoundError: io/cucumber/core/gherkin/FeatureParser
  29. Unable to run JUnit test with PowerMockRunner
  30. Specifying order of execution in JUnit test case [duplicate]

Leave a Comment