The Performance Requirements report validates the performance requirements that you set in a schedule. If your protocol supports test requirements, the report validates performance requirements that you set in a test. Validation is accomplished by comparing the data in the run to the performance requirements that you set on the data.
Each performance requirement has a row in the table that explains the target of the performance requirement (for example, an HTTP page), specification, and status.
The first table presents the pass/fail status and percentage pass data for performance requirements and supplemental performance requirements.
Both performance requirements and supplemental performance requirements are represented in the center of the report by a pie chart. In both cases, failures are shown in red and passes are shown in green.
The final graphic on this page presents numeric details for each performance requirement type and for the union of both types.
As with the Status Summary page, the overall status of the run and percent passed value for the run are presented in a table at the top of the page. The bar chart at the center of the report displays the margin of each performance requirement. The margin is a percentage value that allows improvement or regression analysis with regards to a performance requirement. When a performance requirement is in the “passed” state, it will have a margin >= 0. The margin is calculated as follows:
% Margin = abs(specification – observed)/specification
When a performance requirement is in the “failed” state, it will have a value <=0. The margin is calculated as follows:
%Margin = –abs(specification – observed)/specification
Margins are useful in comparison mode because you can detect improvement or regressions before they are significant enough to change the requirement from pass to fail. The table at the bottom of the Details page contains a representative row for each performance requirement. Each requirement is presented with an explanation of its target, observed result, specification, margin, and status. Passed statuses are shown in green and failed statuses are shown in red.