Manage real-time computing nodes

更新时间:
复制 MD 格式

The Real-time Computing Nodes page in DataWorks displays basic information and runtime details for your node instances, allowing you to monitor their status. You can also configure alerts to promptly detect and handle exceptions.

Limitations

DataWorks currently supports O&M only for tasks submitted from EMR Spark Streaming and Flink SQL Streaming nodes.

Go to the real-time computing nodes page

  1. Log on to the DataWorks console. In the top navigation bar, select the desired region. In the left-side navigation pane, choose Data Development and O&M > Operation Center. On the page that appears, select the desired workspace from the drop-down list and click Go to Operation Center.

  2. In the left-side navigation pane, click Real-time Task O&M > Real-time Computing Node to go to the Real-time Computing Nodes page.

List of real-time computing nodes

The Real-time Computing Nodes page in Operation Center displays a list of real-time compute nodes in the production environment. On this page, you can view basic information about the nodes, perform O&M operations such as Start, Terminate, and Undeploy, and configure alerts for node failures.实时计算任务

Area

Description

1

In this area, you can filter real-time compute nodes by criteria such as Node ID, Node Name, Status, Cluster Type, Cluster Name, Task type, and Owner.

Note
  • Search results for Node ID or Node Name are affected by other filter conditions. The query returns only nodes that meet all filter criteria.

  • Searching by Node Name supports fuzzy match. When you enter a keyword, the search returns all real-time compute nodes with names containing that keyword.

2

In this area, you can view the basic information and running status of the target nodes.

  • Node Name: The name of the node. Click the node name to go to the details page for the target node.

  • Node ID: The ID of the node.

  • Running status: The running status of the node. The possible states include Not Running, Generating, Waiting for resources, Starting, Running, Stopped, Failed, Restarting, and Undeploying.

  • Start running: The time when the node started running.

  • End Running: The time when the node stopped running.

  • Run when Long: The node's total runtime, in seconds.

  • Task type: The type of the node.

    Note

    DataWorks currently supports O&M only for tasks submitted from EMR Spark Streaming and Flink SQL Streaming nodes.

  • Cluster Type: The type of cluster that the node uses. DataWorks currently supports O&M only for real-time compute nodes that run on E-MapReduce and Flink clusters.

  • Cluster Name: The name of the cluster where the node runs.

  • Deployed At: The time the node was deployed, in yyyy-MM-dd HH:mm:ss format.

  • Owner: The person in charge of the node's workspace.

Note

You can sort nodes in ascending or descending order by Start running, End Running, or Run when Long.

3

In this area, you can perform the following operations on a node.

  • Start: Starts a real-time compute node that is not running.

  • Terminate: Terminates a running real-time compute node.

  • Undeploy: Undeploys a real-time compute node.

  • Monitoring Setting: Configures monitoring for a node's running status. If the node fails, DataWorks sends an alert to the specified alert contacts via SMS, Email, Telephone, DingTalk Chatbot, or Webhook.

    To configure an alert contact's Email and Telephone, see Set the mobile phone number and email address for an alert contact. To configure a DingTalk chatbot and get its webhook URL, see Use case: Send alert messages to a DingTalk group.

4

In this area, you can select multiple nodes to perform bulk operations: Start, Terminate, Undeploy, or configure Monitoring Setting.

Real-time compute node details

In the node list, click a node name to open its details page. On the details page, you can view the node's Details, Runtime Log, Operation Log, and Code. This allows you to quickly find operation records and troubleshoot errors.实时计算任务详情页面