View instance statistics-Dataphin(Dataphin)-阿里云帮助中心

Instance statistics provide insights into the operational details, trends, and rankings of offline and real-time instances within the system. This includes the number of failed instances and failure alerts, facilitating monitoring of instance operations from both a project and global perspective. This topic introduces the instance statistics available in the Operation Center.

Statistics explanation

The instance statistics feature aggregates data from instances in the production environment.
For logical table task instances, the statistics represent the number of actual materialized instances corresponding to the logical table, which may differ from the numbers shown in the detail and aggregate table lists.

Instance statistics entry

On the Dataphin home page, single click the Development tab in the top menu bar. By default, you will be directed to the data Development page.
To access the Instance Statistics page, follow these steps:
Single click O&M -> Instance Statistics.

Instance statistics page introduction

The instance statistics page mainly consists of Running Details, Running Trends, and Rankings. You can view the instance running status on the instance statistics page.

teat

Number	Description
①Instance tabs	The dashboard displays operational metrics for offline and real-time instances. Click the Offline Instances or Real-time Instances tabs to view corresponding data.
②Global and project perspectives	View instance statistics from both global and project perspectives. By default, the project perspective is selected, displaying an operational overview of a specific project. You can switch to view statistics for different projects. To view the global operational overview at the tenant level, click the icon. On the instance statistics page, operational statistics under Operational Details will update in real-time. Additionally, you can single click the icon to manually refresh the data. Operational details support filtering by Data Timestamp, Scheduled Running Time, and Operational Date. Scheduled Running Time: The scheduled start time of the task. You can select a date range, defaulting to the current day. Operational Date: This represents the task's actual start time. Users can specify a range for the data timestamp, with the default set to the current day. Instances in the Not running or Waiting status are excluded from the count. Data Timestamp: The business date of the task. You can select a data timestamp range, defaulting to the current day. Viewing Operational trends is not supported when filtering by data timestamp. Click View Comments to understand the significance of each metric.
③Operational details	Shows operational details, including the total number of instances and the proportion of instances in each status. It also displays the total number of Recurring Instances, One-time Instances, and Data Backfill Instances. The instance source module is represented through a column chart. Hovering over the chart reveals the name of the instance source module and the number of recurring, data backfill, and one-time instances.
④Operational trends	Shows the operational data and trends of recurring, one-time, and data backfill instances over the past 15 days. Hovering over a specific operational date reveals the operational status of instances for that day. If you have selected Total Number Of Running Instances, Successful Runs, and Failed Runs, you can view the Failed Runs, Total Number Of Running Instances, Successful Runs, and 15-day Average Of Failed Instances for that day. Note Run Date supports viewing the Running Trend.
⑤Instance operational statistics	On the Offline Instances page, view the Ranking Of Failed Instances and the Ranking Of Tasks Corresponding To Failed Instances. On the Real-time Instances page, view the Ranking Of Instances With Failure Alerts and the Ranking Of Instances With Delay Alerts. Note In the global perspective, viewing Instance Operational Statistics is supported.

If you lack permission to view global scope data, request the necessary permissions. For more information, see Configure and change owner permissions.

View offline instance statistics

Operational Details

The operational details section displays the status of code tasks, sync tasks, pipeline tasks, logical tables, and extract tasks. View details of instances in each status, including distribution by business and scheduling types.

Prioritize failed instances with an operational date of the current day (i.e., data timestamp of T-1) and assess the types of failures to mitigate business impact and take timely action.

Number

Description

①Number of operational statuses

Shows the number and proportion of instances in each status.

Note

For logical table tasks, the statistics represent the number of materialized nodes, not the number of logical task nodes.

②Distribution

Displays the distribution of recurring, one-time, and data backfill instances for each business type based on the selected operational status in area ①.

When the project perspective is selected ( icon), the system presents information tailored to the chosen project:

Selecting the extract project (Data_distill) omits Logical Table from the horizontal axis.
For non-extract projects (Data_distill), the horizontal axis excludes Extract.

In the global perspective ( icon), the horizontal axis includes Data Processing - Sync & Pipeline, Data Processing - Code Tasks, Logical Table, and Extract.

Operational Trends

The operational trends section illustrates the 15-day trend of recurring, one-time, and data backfill instances, aiding in the identification of abnormal patterns.

Important

Operational trends are not available when filtering by data timestamp.

Number	Description
①Instance tabs	Select tabs for recurring, one-time, and data backfill instances to view corresponding trends.
②Filter and download CSV	Click the icon to filter by business category. Click Download CSV to download the operational status of instances for the past 15 days.
③Trend chart	Select trends for running instances, successful runs, and failed runs to display in the trend chart. Hover over the trend chart to view the operational status for that day. If running instances, successful runs, and failed runs are selected, hovering will display the Total Number Of Running Instances, Successful Runs, Failed Runs, and 15-day Average Of Failed Instances.

Instance Operational Statistics
Important
Instance operational statistics are available when viewing the instance statistics page in the global perspective ( icon).
Instance operational statistics display rankings by project, including the number of failed instances and tasks associated with those failures. Hourly and minute tasks generate multiple instances daily, and these perspectives can help pinpoint different issues. For concerns about failed tasks, consider the task ranking. If the focus is on the impact on current business data, the instance ranking is recommended.
Click View Comments for explanations of the number of failed instances and tasks. Click Download CSV to download the ranking data.

View real-time instance statistics

Operational Details
The operational details section shows the status and number of instances for each code type. Prioritize failed instances with an operational date of the current day (i.e., data timestamp of T-1) to assess their impact on business and take appropriate action.

Operational Trends

Operational trends show the number of running, in-progress, paused, and stopped instances.

Important

Operational trends are not available when filtering by data timestamp.

Number

Description

①Business category filter area

Click the icon to filter by business category, including options like FLINK_SQL, FLINK_TEMPLATE_SQL, and FLINK_DATASTREAM.

Click Download CSV to download operational details for the past 15 days.

②Operational trend chart

Select trends for running instances, in-progress instances, paused instances, and failed instances to display in the trend chart.

Hover over the trend chart to view the operational status for that day. If running instances, in-progress instances, paused instances, and stopped instances are selected, hovering will display the total number of instances, instances in progress, paused instances, and stopped instances.

Instance Operational Statistics
Important
Instance operational statistics are available when viewing the instance statistics page in the global perspective ( icon).
Instance operational statistics display rankings by project, showing the number of instances with failure and delay alerts.