Comparing test runs

Select an enumerated attribute and compare two test runs based on that attribute. For example, you might want to compare the results that are stored in a Test Status enumerated attribute to see changes in the pass rate for the tests.

Procedure

  1. Click Tools > Test Tracking > Compare Test Runs.
  2. By default, the last two test runs are compared. If you want to compare different test runs, type the numbers in the Test runs to compare fields.
  3. Click Collect Data. On the list view tab, the Old Value and New Value columns display all the changes that have been made to the attribute value. The Number of test cases column displays the number of test cases that have changed in that way.

Results

You can sort the results in the List view by clicking the column title.

To see a graphic view of the results, click the Graphic View tab.

To filter the module on a transition, select the field next to the transition you want to filter on and click Filter Tests. You can filter the module from the Graphic View tab by selecting the circle that represents the transition that you want to filter on.

You can create a comparison view, which shows the differences between the two test runs in all the attribute columns that are displayed. Select Convert view to show comparison and select the view that you want to convert. Click Filter Tests. The view that you selected is displayed, and the results of each test run are shown in each of the columns in the view. If you have selected to filter the module on certain transitions, only the objects that match the filter are displayed.


Feedback