Alibaba Cloud DevOps Testhub provides end-to-end test management covering test case design, test plan execution, and test reporting.
Alibaba Cloud DevOps Testhub supports the entire testing lifecycle, from test case design and test plan execution to test reporting. The test management homepage provides entry points to these modules. Get started at: Alibaba Cloud DevOps Testhub
Test case design
Test case library
A test case library lets your team accumulate and maintain reusable test cases across multiple projects. On the test case homepage, you can Create a Test Case Library to store test cases for your product.
Design test cases
In a test case library, the first step is to design the directory structure. This structure typically represents concepts such as product, sub-product, module, feature, and scenario. The specific organization depends on your team's design standards.
The test case library page displays the directory hierarchy as a tree on the left and a list of test cases for each directory on the right. Click the New button in the upper-right corner and select Import Data from the drop-down menu to import test cases in bulk.
After planning the directory, you can begin writing test cases. Alibaba Cloud DevOps Testhub uses a classic test case format that includes fields such as prerequisite, steps, expected result, priority, and Type.
The new test case form also includes fields such as Test Case Title, Directory, Assignee, tag, and Attachment. The Prerequisite field supports rich text and Markdown, while steps and expected result are entered row-by-row in a table.
Test plan
Enable the test service
To manage tests within a development project, go to Project in Alibaba Cloud DevOps and find your project. Then, navigate to and enable the Test toggle. This lets your team create test plans, execute test cases, and log defects within the project.
Test planning
After enabling the test service, you can create a test plan for the project from the Test page. The cadence of a test plan should typically follow the development plan. If your development plan uses iterations, you can associate the test plan with an iteration.
The overview page of a test plan includes several sections: Plan Information (plan name, associated project, associated iteration, and plan dates), Execution Status (a donut chart showing the test case pass rate and the count for each status), Plan Members (administrators and participants), Executors (test progress grouped by assignee, showing metrics such as assigned cases, executed cases, and pass rates), and Related Defects (a list of defects found during testing).
The main task in creating a test plan is adding test cases from a test case library. Alibaba Cloud DevOps Testhub allows you to add test cases from multiple libraries to a single test plan. Similarly, test cases from one library can be reused in test plans across multiple projects.
In the Add Test Case dialog box, use the drop-down menu on the left to select a test case library and browse its directory structure. The corresponding list of test cases (including title, priority, and tags) appears on the right. Select the desired test cases and click OK to add them.
Test execution
You can assign test cases in a test plan to different testers for execution. On the test plan's overview page, you can track the progress of each tester. Testers can view the list of test cases assigned to them in the test plan, run the tests, update the execution status, and log any defects found during the process.
In the Defect column of the test case list, click the + button and select New Defect or Associate Defect from the drop-down menu.
Test reports
After the test plan is complete, return to the Test Management page and create a test report to summarize this testing phase. The report lets you assess the overall testing process and quality results, and display test case and defect data using charts and data lists. You can download the finished report and distribute it via email or instant messaging tools.
In the Information panel on the right side of the report editor, you can set the Report Name, Execution Date, and Associated test plan. Note that the associated test plan cannot be changed after the report is created. The main editing area includes a Report Summary rich text editor (which supports bold, italics, images, and tables) and Test overview statistics. When you finish editing, click Save Report in the upper-right corner.