Field Editing and Value Assignment

Prerequisites

1. Create a data source. For more information, see Data source management.

2. Create a Data Integration task. For more information, see Configure a single-table real-time synchronization task.

   Note

   For single-table real-time Data Integration tasks, you can add a data processing component between the source and destination components. For more information, see Supported data sources and synchronization solutions.

Add a field during synchronization

1. In a real-time synchronization task for a single table, turn on the Data Processing switch.

2. Click +Add Node, and then add the Edit Field and Assign Value component.

3. Configure the field editing and value assignment component. Select the ancestor fields to output to the downstream component, add the fields that you need, and assign a value to each new field. For a description of every column and value assignment method, see Field settings.

4. After you configure Source and Field editing and value assignment, click Output Preview to view the output data of the current node and check whether it meets your requirements.

5. In field mapping, configure the mapping between each new field and a field in the destination table.

   Important

   A newly added field can be written to the destination table only after you configure its mapping to a destination table field in field mapping.

Field settings

The field editing and value assignment component works on two groups of fields: the fields that the ancestor component outputs, and the fields that you add manually.

• Ancestor fields: the fields that the ancestor component outputs to the field editing and value assignment component. The following columns describe these fields:

  • Field Name: The name of the field that the ancestor component outputs.

  • Type: The data type that the ancestor component outputs.

  • Value: For a field that already exists in the ancestor component, the value is the ancestor output. For a new field, three value assignment methods are available: constant, variable, and function.

  • Actions: For an ancestor output field, specify whether to output the field to the downstream component.

• Custom Field: Click Add Field in the lower-left corner of the field editing and value assignment page to add a new field. Assign a value to the new field by using one of the following methods:

  • Constant: Converts the constant text that you enter manually to the specified data type and then assigns it to the new field.

  • Variable: Assigns the value of a built-in variable to the new field at synchronization runtime. For the variables that you can select, see Supported variables.

  • Function: Performs a function calculation at synchronization runtime and assigns the result to the new field. If an exception occurs while the function is processed, the record is treated as dirty data and counted in the dirty data statistics of the synchronization task. The dirty data tolerance configuration then determines whether the task exits abnormally. For the functions that you can select, see Supported functions.

Supported variables

Select the variable value assignment method to fill a new field with a value that the synchronization task resolves at runtime. The following table lists the supported built-in variables.

Supported functions

Select the function value assignment method to calculate the value of a new field at synchronization runtime. The following functions are supported.

In the time formats that these functions use, such as yyyy-MM-dd HH:mm:ss:SSS ZZ, yyyy indicates the year, MM the month, dd the day, HH the hour in the 24-hour clock, mm the minute, ss the second, SSS the millisecond, and ZZ the time zone.