iTAG provides a metrics dashboard that displays data for annotation, inspection, and acceptance. On the dashboard, you can view metrics categorized by overall data, business, task, and personnel. This topic describes how to view the metrics dashboard.
Procedure
-
Go to iTAG.
-
Log on to the PAI console.
-
In the navigation pane on the left, click Workspace List. On the Workspace List page, click the name of the workspace that you want to manage.
-
In the navigation pane on the left, choose Data Preparation > iTAG.
-
-
Click Metrics Dashboard to navigate to the Management Hub > Metrics Dashboard page.
The Metrics Dashboard entry is located in the Common Features area on the right side of the iTAG homepage.
-
You can view metrics categorized by overall data, business, task, or personnel.
Area
Description
①
Overall data
Displays data metrics from the previous day, including the following:
-
Total annotations (including rejected): The total number of annotations in the workspace, including annotations rejected during quality inspection and acceptance.
-
Total annotations (excluding rejected): The total number of annotations in the workspace, excluding annotations rejected during quality inspection and acceptance.
-
Effective working hours (hours): The time spent on each data annotation.
-
Annotation efficiency (items/hour): The number of data annotations per hour.
②
Business dimension
Displays a summary of data metrics for annotation, inspection, and acceptance, grouped by business. To configure business types, go to the Tenant Configuration>Cloud Resource Configuration page and select Business Type Configuration.
③
Task dimension
Displays a summary of data metrics for annotation, inspection, and acceptance, grouped by task.
④
Personnel dimension
Displays a summary of data metrics for annotation, inspection, and acceptance, grouped by operator.
⑤
Time range
You can filter and view data metrics by the following time dimensions or a custom time range.
-
Single day: Displays data metrics for a specific day.
-
Previous week: Displays data metrics for the previous week.
-
Previous month: Displays data metrics for the previous month.
⑥
Data metric calculation method
Data metrics can be calculated in the following two ways:
-
By sample: Each piece of data in a dataset is a sample. When a single-choice or multiple-choice label is applied to the data, the annotation count is 1.
-
By operational unit: Each item in a dataset can have multiple parts to annotate. When you apply multiple labels to a single data item, each annotation is counted as one operational unit. For example, in an object detection scenario, if you select three labels for a bounding box, it is counted as three operational units.
-