What are the differences between unit tests, integration tests, smoke tests, and regression tests? [closed]

by

  • Unit test: Specify and test one point of the contract of single method of a class. This should have a very narrow and well defined scope. Complex dependencies and interactions to the outside world are stubbed or mocked.

  • Integration test: Test the correct inter-operation of multiple subsystems. There is whole spectrum there, from testing integration between two classes, to testing integration with the production environment.

  • Smoke test (aka sanity check): A simple integration test where we just check that when the system under test is invoked it returns normally and does not blow up.

    • Smoke testing is both an analogy with electronics, where the first test occurs when powering up a circuit (if it smokes, it’s bad!)…
    • … and, apparently, with plumbing, where a system of pipes is literally filled by smoke and then checked visually. If anything smokes, the system is leaky.

  • Regression test: A test that was written when a bug was fixed. It ensures that this specific bug will not occur again. The full name is “non-regression test”. It can also be a test made prior to changing an application to make sure the application provides the same outcome.

To this, I will add:

  • Acceptance test: Test that a feature or use case is correctly implemented. It is similar to an integration test, but with a focus on the use case to provide rather than on the components involved.

  • System test: Tests a system as a black box. Dependencies on other systems are often mocked or stubbed during the test (otherwise it would be more of an integration test).

  • Pre-flight check: Tests that are repeated in a production-like environment, to alleviate the ‘builds on my machine’ syndrome. Often this is realized by doing an acceptance or smoke test in a production like environment.

More Related Contents:

  1. Should I test private methods or only public ones? [closed]
  2. What’s the difference between faking, mocking, and stubbing?
  3. What is the difference between unit tests and functional tests?
  4. How to run only one unit test class using Gradle
  5. Fill os.Stdin for function that reads from it
  6. How to test my servlet using JUnit
  7. Updating input html field from within an Angular 2 test
  8. Is it possible to mock a function imported from a package in golang?
  9. Testing os.Exit scenarios in Go with coverage information (coveralls.io/Goveralls)
  10. Unit testing a method that calls another method
  11. How to mock specific methods but not all of them in Rust?
  12. What is a “Stub”?
  13. Is it possible to mock a function imported from a package?
  14. Unit Testing C Code [closed]
  15. What Makes a Good Unit Test? [closed]
  16. Final method mocking
  17. What is unit testing? [closed]
  18. Mock functions in Go
  19. Configuring IntelliJ IDEA for unit testing with JUnit
  20. What’s a good way to overwrite DateTime.Now during testing?
  21. Do MSTest deployment items only work when present in the project test settings file?
  22. How can one mock/stub python module like urllib
  23. How to avoid multiple asserts in a JUnit test?
  24. Writing unit tests in Python: How do I start? [closed]
  25. How do I run NUnit in debug mode from Visual Studio?
  26. Should it be “Arrange-Assert-Act-Assert”?
  27. how to share a variable across modules for all tests in py.test
  28. How to specify test directory for mocha?
  29. Writing “unit testable” code?
  30. Why should unit tests test only one thing?

Leave a Comment