Configure the Lindorm (compute engine) output component

Prerequisites

• You have created a Lindorm (compute engine) data source. For more information, see Create a Lindorm (compute engine) data source.

• The account that you use to configure the properties of the Lindorm (compute engine) output component requires write-through permission for the data source. If you do not have this permission, request it for the data source. For more information, see Request data source permission.

Procedure

1. On the Dataphin home page, choose Development > Data Integration from the top menu bar.

2. From the top menu bar of the Data Integration page, select Project. In Dev-Prod mode, you must also select an environment.

3. In the navigation pane on the left, click Batch Pipeline. In the Batch Pipeline list, click the offline pipeline that you want to configure to open its configuration page.

4. In the upper-right corner of the page, click Component Library to open the Component Library panel.

5. In the navigation pane on the left of the Component Library panel, select Output. In the list of output components on the right, find the Lindorm (compute engine) component and drag it to the canvas.

6. Click and drag the icon from the target upstream component to the Lindorm (compute engine) output component to connect them.

7. Click the icon on the Lindorm (compute engine) output component card to open the Lindorm (compute engine) Output Configuration dialog box.

8. In the Lindorm (compute engine) Output Configuration dialog box, configure the parameters.

   Parameter		Description
   Basic settings	Step Name	The name of the output component. Dataphin automatically generates a step name that you can modify. The naming conventions are as follows: The name can contain only Chinese characters, letters, underscores (_), and digits. The name cannot exceed 64 characters.
   	Datasource	Lists all Lindorm (compute engine) data sources in Dataphin and indicates whether you have write-through permission for each one. Click the icon to copy a data source name. If you do not have write-through permission for a data source, click Request next to the data source to request the permission. For more information, see Request data source permissions. If you do not have a Lindorm (compute engine) data source, click Create to create one. For more information, see .
   	Table	Select the target table for the output data. Click the icon to copy the table name. Important If the table schema changes, you must reconfigure the pipeline node.
   	File Encoding	The supported encoding formats are UTF-8 and GBK.
   	Loading Policy	Specifies how data is loaded into the target table. Append data: Appends data to the target table. Overwrite all data: Deletes all existing data in the target table or configured partition before writing new data.
   	Compression Format	Optional. If the source file is compressed, select the matching compression format so that Dataphin can decompress it. Supported formats: zlib, hadoop-snappy, lz4, and none. ORC tables use zlib compression by default. Tables in other formats have no default compression format.
   	Performance Configuration	Tunes write performance for ORC-format output tables with many fields. Increase the buffer size if memory is sufficient, or decrease it to reduce garbage collection (GC) time when memory is limited. The default value is {"hive.exec.orc.default.buffer.size":16384} in bytes. Do not configure a value larger than 262,144 bytes (256 KB).
   	Partition	For partitioned tables in a non-Iceberg format, specify a fixed static partition for write operations, such as hh=xx,mm=xx. Iceberg-format tables support dynamic partitions, so you do not need to configure partitions, but the field mapping must include the partition fields. If static partitions are configured, they are used for write operations.
   	Prepare Statement	An SQL script to run on the database before data import.
   	End Statement	An SQL script to run on the database after data import.
   Field mapping	Input Field	The input fields from the upstream component.
   	Output Field	The output fields. Click Field Management to select output fields. Click the icon to move Selected Input Fields to Unselected Input Fields. Click the icon to move Unselected Input Fields to Selected Input Fields.
   	Mapping	Mappings connect input fields from a source table to output fields in a target table. Two mapping modes are available: Same-name mapping: Maps fields that have the same name. Same-row mapping: Maps fields by their row position when field names in the source and target tables do not match.

9. Click Confirm to save the configuration for the Lindorm (compute engine) output component.