Test reports

Create a test report

When a testing phase is complete, manage your test reports in the test report module of Alibaba Cloud DevOps Testhub. The test report list is divided into the All Reports and My Reports views and is searchable by name, creation time, and creator.

Click New Report in the upper-right corner, enter a report name, and select one or more test plans. Alibaba Cloud DevOps Testhub lets you associate multiple test plans, which is useful for multi-team collaboration scenarios. The report's data comes from the test cases and defects within the selected plans. Generating the report may take some time, depending on the data volume.

In the Associated Test Plan field, you can link up to 15 test plans. The drop-down list is searchable and displays the execution status of each plan on the right.

Edit a test report

After a test report is created, you can modify the following information:

• Report name and execution date.

• Summary

• Style template

The execution date specifies the testing period covered by the report. It is for informational purposes only and is not tied to the dates of the test cases or defects. You cannot modify the test plans associated with a report. To change them, create a new test report. The report style only affects its appearance, not its content.

Click the Information tab on the left. The editing panel opens on the right, where you can modify the Report Name (up to 100 characters) and Execution Date.

Click the Style tab on the left. In the panel that appears on the right, select a report template. Available styles include Blue, White, Orange, and Black.

View a test report

A test report displays test execution data as data cards.

This page includes four statistical metrics: total number of test cases, total number of defects, high-priority defects, and critical defects. It also features a test statistics donut chart, a defect fix rate donut chart, a test plan details table, and a defect severity distribution bar chart.

Comprehensive statistics

• Total number of test cases: The number of test cases from the associated test plans.

• Total number of defects: The number of defects linked from test cases in the associated test plans.

• High-priority defects: The number of defects with an Urgent or High priority.

• Critical defects: The number of defects with a Blocker or Critical severity.

Test case statistics

This metric breaks down the total number of test cases by their execution status.

Defect fix rate

This metric breaks down the total number of defects by their status. The "Unresolved" status includes states such as "To be confirmed", "In progress", and "Reopened". The "Resolved" status includes states such as "Fixed", "Won't fix", and "Invalid". "Closed" is the final state.

Test plan details

This table lists all test plans associated with the report and includes the following details:

• The test plan name.

• Execution progress of test cases: A test case is considered executed whether it passed or failed. Execution progress is distinct from the pass rate.

• Pass rate of test cases: The percentage of test cases that passed.

• Test plan administrator: The primary contact for questions about the test plan.

• Associated project/iteration: The project and iteration from which the test plan originates.

Defect severity distribution

This chart breaks down defects by severity and status for each associated test plan. The defect priority distribution chart is displayed in a similar format.

High-priority and critical defects

This list displays defects with an Urgent or High priority, or a Blocker or Critical severity. These defects can impact product quality and require close monitoring.

Export a test report

In Alibaba Cloud DevOps Testhub, you can export test reports as images or PDF files for sharing via email or instant messaging (IM). You can download a report from the test report list or from its details page.