Analyzing test results

At the conclusion of a test run you see an execution history, including a test verdict, and you can request two graphical reports showing a page response time and a page hit analysis.

Immediately after running a test you see the Overview tab of the Execution Summary report, shown below.

The execution summary gives the test's verdict, the time recording started, and the time recording stopped. The verdict may be one of the following:

For tests that fail, the Events tab shows you the overall verdict and allows you to drill down to the requests in each page that returned a fail code.

For example, expanding Page 5reveals that a request returned a code of 404.

Two analysis reports are available. The Page Response Time report is a bar graph showing the seconds required to process each page in the test and the average response time for all pages.

The Page Hit Rate report is a bar graph showing the hits per second to each page and the total hit rate for all pages. The exact numbers displayed at the top of the bars (availabe on the Page Response Time as well) do not appear unless you click one of the bars.

In order to view the Page Response Time and the Page Hit Rate reports, you need to install Adobe's Scalable Vector Graphics (SVG) browser plug-in. You can get this free viewer from the Adobe web site at http://www.adobe.com/svg/viewer/install/main.html.

To generate reports from a test's results:

  1. In the test navigator, right-click the test and select Report. Page one of the New Report wizard opens.
  2. Click the type of report you want to create. If you want to see the report immediately, without having to browse to it, leave the Open Report Automatically box checked. When you click Next, the second page of the New Report wizard opens.
  3. From the list of projects in the middle pane, click the one that you want to put the report file in: the project's name appears in the Enter or select the parent folder box.
  4. In the File name box, enter the name of the report file.
  5. Click Finish.

If you left the Open Report Automatically box checked in step 1 (assuming you have the SVG viewer installed), the report opens in your browser. To navigate to the report files, you need to add the unfiltered Navigator view to the test navigation pane. For instructions, see Rearranging views and editors.

Parent topic: Performance Testing with TPTP

(C) Copyright IBM Corporation 2000, 2004. All Rights Reserved.