HomeLoginHelp Factory

Glossary: test case history stats

Case history statistics analyse the changes in test case state over a series of tests. Several categories of changes are recognized:

  • Success, violation, failure: indicate that the test case result remained constant throughout all tests that included the test case and was equal to the corresponding result.

  • All stable: indicate that the test case result remained constant throughout all tests that included the test case.

  • Fixed: indicates that the test case that resulted in failure or violation during the first test(s), later resulted in success.

  • Broken: indicates that the test case that resulted in success during the first test(s), later resulted in violation.

  • All changed: indicates that the test case result has changed. This includes fixed and broken test cases.

  • Added: indicates that the test case was not used during the first test execution(s).

  • Deleted: indicates that the test case was not used during the last test execution(s).

  • Other: an outcome history that does not match any of the pre-defined outcome categories or patterns.

  • All: any outcome history.

Note that the same rules apply when comparing more than two test results. In most cases, if the result of the test case has changed more than once, the case is classified as other. If you do not care about intermediate test results, you probably should not include intermediate tests in your comparison.

Categories with no members for a given test comparison may not be shown.

See also: test case state.



© The Measurement FactoryCo-Advisor  ·  2.0.0b10terms  ·  privacy