Test management

Test management is the activity of managing some tests. A test management tool is a Software used by Quality Assurance team to manage the tests (automatic or not) that have been previously specified. It is often associated with an Automation software. Test Management Tools often include Requirements and/or Specifications management modules that allow to automatically generate the RTM (Requirement Test Matrix) which is one of the main metric to know the functional coverage of the SUT (System Under Test). This means checking how many requirements and/or specifications are covered by the available tests. It is not code coverage, a totally different concept.

Creating tests definitions in a database

Test definition includes: test plan, association with product Requirements and Specifications. Eventually, some relationship can be set between tests so that precedences can be established. i.e. if test A is parent of test B and if test A is failing, then it may be useless to perform test B. Tests should also be associated with priorities. Every change on a test must be versioned so that the QA team has a comprehensive view of the history of the test.

Preparing test campaigns

This includes building some bundles of test cases and execute them (or scheduling their execution). Execution can be either manual or automatic.

Manual execution
The user will have to perform all the test steps manually and inform the system of the result. Some test management tools includes a framework to interface the user with the test plan to facilitate this task.

Automatic execution
There are a numerous way of implementing automated tests. Automatic execution requires the test management tool to be compatible with the tests themselves. To do so, test management tools may propose proprietary automation frameworks or APIs to interface with third-party or proprietary automated tests.

Generating reports and metrics

The ultimate goal of test management tools is to deliver sensitive metrics that will help the QA manager in evaluating the quality of the System Under Test before releasing. Metrics are generally presented as graphics and tables indicating success rates, progression/regression and much other sensitive data.

Managing bugs

Eventually, test management tools can integrate bug tracking features or at least interface with well-known dedicated bug tracking solutions (such as bugzilla or mantis) efficiently link a test failure with a bug.

Planning test activities

Test management tools may also integrate (or interface with third-party) project management functionalities to help the QA Manager planning activities ahead of time.