Data parsing workbench

更新时间:
复制 MD 格式

This topic describes the navigation bar, canvas, and operations bar of the data parsing workbench.

Background information

You can use the data parsing workbench to configure a data parsing task to analyze and process data from a data source connected to Data Service. For more information, see User guide.

Access the data parsing workbench

  1. On the Instance Overview page of the IoT Platform console, click the ID or alias of the target Enterprise instance.

  2. In the navigation bar on the left, choose Data Service > Data Parsing.

  3. On the Data Parsing page, find the data parsing task that you want to configure and click View in the Actions column.

    The data parsing workbench is organized as follows:

    • Navigation bar on the left: Displays function nodes.

    • Center canvas: Used to configure function nodes. A source node is added by default.

      On the canvas, click a node to configure it in the right-side panel. After configuring a node, click the add image icon next to it and select the next node to add. The new node is automatically added and connected.

      Note

      You cannot drag nodes from the navigation bar on the left to the canvas.

    • Top operations bar: Used to manage the entire data parsing task.

    Note
    • A data parsing task can have one input node, multiple processing nodes, and one output node.

    • Each node can use data from the preceding nodes.

    • Data Filtering can be configured before or after Data Compute.

Left navigation bar

Function

Node

Description

Related topic

Input

source node

Selects the data source for the data that you want to process.

Configure a source node

Custom

If the Topic format of the data source in the source node is set to raw data, a Custom node is automatically added and connected after the source node. You can use this node to configure a custom script to parse the raw data.

Write a custom script

Process

Data Compute

This node automatically matches and displays relevant field data based on the source node configuration.

You can configure an expression to compute new fields from existing ones.

Configure Data Compute and Data Filtering

Data Filtering

Filters data based on specified criteria.

Value Conversion

Converts a field's value based on conditional logic. The result can be output to the original or a new field.

Configure Value Conversion

Data Aggregation

This node aggregates and computes fields from messages within a specified time window, similar to window functions in Flink SQL.

Configure Data Aggregation

Timeout Interpolation

Prevents data discontinuity by using a fixed policy to fill in values when data reporting is interrupted.

Configure Timeout Interpolation

Adjacent Message Compute

This node takes the values of the same numeric field (BIGINT and DOUBLE types only) from the current and previous messages, performs a calculation based on a defined expression, and outputs the result to a specified output field.

Configure Adjacent Message Compute

Output

destination node

Forwards the parsed data to an IoT Platform instance topic or IoT Digital Twin, or stores it in a custom storage table of the IoT Platform instance.

If you choose to store data in a custom storage table, the system automatically displays the fields that can be output based on the output configuration of the processing nodes. You can delete or modify fields as needed to complete the final output configuration.

Configure a destination node

Canvas

Function

Description

调试

Located in the upper-left corner of the canvas.

After you finish the configuration, click this icon to run a test.

  • If the test run succeeds, click data structure at the bottom of the canvas to view the parsed content.

  • If the test run fails, an error message appears. Correct the configuration based on the error message and run the test again.

放大

Located in the lower-left corner of the canvas. Click this icon to zoom in.

缩小

Located in the lower-left corner of the canvas. Click this icon to zoom out.

调整位置

Located in the lower-left corner of the canvas. Click this icon to automatically adjust the positions of all nodes on the canvas.

解锁

Located in the lower-left corner of the canvas. This icon indicates that the canvas is unlocked and you can edit the function nodes.

Important

To update the parsing configuration of a data parsing task, you must first stop the task and then unlock the canvas.

锁定

Located in the lower-left corner of the canvas. This icon indicates that the canvas is locked and you can no longer edit the function nodes. The canvas is automatically locked after the data parsing task is started.

data preview

Located at the bottom of the canvas. Allows you to preview the data after it is configured.

data structure

Located at the bottom of the canvas. Displays field names and field types.

Top operations bar

The functions are described from left to right.

Function

Description

返回列表

Click this icon to return to the data parsing task list.

The name of the current parsing task is displayed to the right of this icon.

修改名称

Modifies the Task Name and Description.

Running

Indicates that the task is running.

Last saved

Shows the last save time.

Save

Saves the current configuration.

Start

Starts the current data parsing task. For more information, see Start a data parsing task.

Note

After a task is started, you cannot edit its function nodes.

Stop

Stops the current data parsing task.

更多功能

Click to open the Help menu.