Multi-protocol performance test report

Updated at:

After the test completes, the system automatically collects data from the test run and generates a performance test report. This topic details each section of the report.

Access test reports

  1. Log on to the PTS console. In the left-side navigation pane, choose Performance Testing > Report List.
  2. In the Actions column of the target report, click View Report.
    Note On the report details page, click Export Report in the upper-right corner and then select With Watermark or Without Watermark to export the performance test report as a PDF file.

Sampling logs

On the report details page, click View Sampling Logs in the upper-right corner. In the View Logs panel, click Click to view details in the Actions column to view detailed sampling logs. Viewing sampling logs, either during a test or from the report, helps you quickly identify and troubleshoot issues.

General

The General tab displays the log fields and their corresponding values from the sampling logs.

Timing waterfall

The Timing Waterfall tab shows the time taken by each API.

Call chain view

The Call Chain View tab displays the full call chain details for the tested API, including its upstream and downstream dependencies.

Scenario information

Data summary

This section shows the following parameters.

Parameter Description
Request success rate (%) The request success rate for the scenario during the statistical period.
Average RT (Success/Failure) The average response time (RT) for both successful and failed requests during the statistical period.
TPS The total number of requests during the statistical period divided by the test duration.
Concurrency The number of concurrent users configured for the performance test scenario.
Errors The number of errors that occurred during the performance test. Click the number to view detailed error logs.
Total Requests The total requests sent during the test.

Test information, configuration information, and billing information

The right side of the report page shows the test, configuration, and billing information for the performance test scenario.
Parameter Description
Test information
Start Time The time the scenario test started.
End Time The time the scenario test ended.
Test Duration The duration of the test run.
Configuration information
Stress Source The source of the test traffic selected in the scenario stress configuration.
Configured Duration The test duration set in the scenario stress configuration.
Traffic Model The traffic model selected in the scenario stress configuration.
Number of Specified IPs The number of stress agents configured in the scenario.
Billing information
VUMs consumed The total Virtual User Minutes (VUMs) consumed by the test.
Note If you use an Alibaba Cloud VPC as the stress source, the Configuration information section also displays instance details for the VPC, security group, and VSwitch.

Basic performance metrics

The basic performance metrics section displays time series charts for TPS/concurrency, average RT, and request success rate for the performance test scenario. You can hover over a chart to view the metrics at a specific point in time.

Note For MQTT performance test scenarios, you can also view time series charts for the number of client connections, received message TPS, and sent message TPS.

Business metrics

The Overview tab shows the test results for each sampler.

Parameter Description
Sampler Name The name of the overall scenario or a specific sampler.
Total Requests The total number of requests sent by the sampler during the test.
Average TPS The average TPS for this sampler during the test period. TPS = Total requests from this sampler / Test duration.
Success Rate The success rate of this sampler during the test. Green numbers indicate success, and red numbers indicate failure.
  • Click the success or failure count to quickly view the corresponding logs.
  • Click Details to see the number of failed requests caused by 2xx, 3xx, 4xx, 5xx, or other errors. Clicking the number under Other errors displays error statistics, including ranking, error messages, error count, and percentage.
Average Response Time The average response time for this sampler during the test. Click Details to view the maximum, minimum, and percentile response times.
Traffic (Sent/Received) The amount of traffic sent and received.

Scenario details

The Details > Scenario Details tab of the performance test report provides a scenario overview and detailed business metrics for each sampler. This includes the Request details view and the Performance comparison view.

Note The Performance comparison view is available only for tests that do not use a fixed load model. It includes charts that correlate thread count with throughput and response time (RT), and the distribution of request counts by RT.

Request details view

This view includes charts for status code statistics, scenario concurrency, requests (TPS), success rate, response time, and traffic details. For detailed descriptions of these metrics, see Test metrics.

Performance comparison view

  • Thread count vs. Response Time (RT) chart: Shows how RT changes with the number of concurrent threads. As more users make requests simultaneously, server response times may increase.
  • Thread count vs. Throughput chart: Shows the total server throughput relative to the number of active threads. It helps identify the maximum potential throughput based on the number of concurrent users.
  • Response Time (RT) vs. Request Count Percentage chart: Shows the distribution of requests across different response times. It helps you understand what percentage of requests were completed within a certain time frame.

Test logs

On the Details > Performance Test Logs tab, you can view and search through the logs generated during the test.

Stress agent performance

The Details > Stress Agent Performance tab displays time series charts for the performance of all stress agents used in the test. The charts show metrics such as instantaneous garbage collection (GC) counts and durations, CPU utilization, 5-minute load average, memory utilization, and network traffic. You can also filter the view to see performance data for a specific stress agent.

Note Stress agent performance data is retained for a maximum of 30 days.