Compare Test Results

OctoPerf allows you to compare from two to four test results in the same report.

These comparison report are like standard reports, except the fact that your can select a test result when editing a metric.

Result Names

The comparison reports starts with a Text Report Item that lists the compared tests:

Bench results are referred by letters: A, B, C, D.

In the legend of every report item, these names are used to identify each result:

Note

The Delta Table can be used to compare a single metric value for each compared test result.

Insert Report Items

A specific menu is displayed on the left:

It allows you to quickly insert comparision report items. When inserting these items, you can only select one metric. Then one curve/column/pie is added for each test compared:

Edit Metrics

When editing metrics (for Line Chart curves or Table columns), you can select the bench result:

The Summary Report Item allows this selection directly:

Change labels

You can use the Report configuration page to edit the labels associated with each test:

This will update the labels on all the graphs and menus:

Note

Updating test labels will not affect the blocs of text and titles, these will have to be changed manually.