Configure Vertica output component

Prerequisites

• You have added a Vertica data source. For more information, see Create a Vertica data source.

• The account used to configure the Vertica output component must have the write-through permission for the data source. If you do not have the permission, request it. For more information, see Request, renew, and return data source permissions.

Procedure

1. In the top navigation bar of the Dataphin homepage, choose Develop > Data Integration.

2. In the top navigation bar of the integration page, select Project (In Dev-Prod mode, you need to select Environment).

3. In the left navigation pane, click Batch Pipeline, and then click the offline pipeline that you want to develop in the Batch Pipeline list to open the configuration page of the offline pipeline.

4. Click Component Library in the upper-right corner of the page to open the Component Library panel.

5. In the left navigation pane of the Component Library panel, select Outputs, find the Vertica component in the output component list on the right, and drag the component to the canvas.

6. Click and drag the icon of the target input, transform, or flow component to connect it to the current Vertica output component.

7. On the Vertica output component, click the icon to open the Vertica Output Configuration dialog box.

8. In the Vertica Output Configuration dialog box, configure the parameters.

   Parameter		Description
   Basic Settings	Step Name	The name of the Vertica output component. Dataphin automatically generates a step name, which you can modify as needed. The name must meet the following requirements: It can contain only Chinese characters, letters, underscores (_), and digits. It cannot exceed 64 characters in length.
   	Datasource	The dropdown list displays all Vertica data sources, including those you have write-through permission for and those you do not. Click the icon to copy the current data source name. For data sources you do not have write-through permission for, click Request after the data source to request write-through permission. For more information, see Request data source permissions. If no Vertica data source is available, click Create Data Source to create one. For more information, see Create a Vertica data source.
   	Table	Select the target table for output data. You can enter a keyword to search for a table, or enter the exact table name and click Exact Match. After you select a table, the system automatically checks the table status. Click the icon to copy the name of the currently selected table.
   	Batch Write Size (optional)	The amount of data written per batch. You can also set Batch Write Records. The system writes data when either limit is reached first. Default: 32M.
   	Batch Write Records (optional)	Default: 2048 records. The batch write strategy uses both Batch Write Records and Batch Write Size to control write frequency. When the accumulated data reaches either limit (batch write size or number of records), the system immediately writes that batch to the destination. We recommend setting the batch write size to 32 MB. Adjust the batch write records based on the actual size of a single record, typically to a larger value to maximize batch writing efficiency. For example, if a single record is about 1 KB, you can set the batch write size to 16 MB and set the batch write records to a value greater than 16 MB / 1 KB = 16,384, such as 20000 records. With this configuration, the system triggers a write operation whenever the accumulated data reaches 16 MB.
   	Prepare Statement (optional)	SQL script to execute on the database before data import. For example, to ensure continuous service availability: before writing, the step creates a target table Target_A, then writes data to it. After writing completes, it renames the active table Service_B to Temp_C, renames Target_A to Service_B, and deletes Temp_C.
   	Post Statement (optional)	SQL script to execute on the database after data import.
   Field Mapping	Input Fields	Displays input fields based on the upstream component output.
   	Output Fields	Displays output fields. You can perform the following operations: Field Management: Click Field Management to select output fields. Click the icon to move Selected Input Fields to Unselected Input Fields. Click the icon to move Unselected Input Fields to Selected Input Fields. Batch Add: Click Batch Add to configure in JSON, TEXT, or DDL format. Batch configuration in JSON format, for example: // Example: [{ "name": "user_id", "type": "String" }, { "name": "user_name", "type": "String" }] Note name specifies the field name, and type specifies the data type after import. For example, "name":"user_id","type":"String" imports the user_id field with its data type set to String. Batch configuration in TEXT format, for example: // Example: user_id,String user_name,String The row delimiter is used to separate the information of each field. The default is a line feed (\n). It supports line feed (\n), semicolon (;), and period (.). The column delimiter is used to separate the field name and field type. The default is a comma (,). Batch configuration in DDL format, for example: CREATE TABLE tablename ( id INT PRIMARY KEY, name VARCHAR(50), age INT ); Create Output Field: Click +Create Output Field, fill in the Column and select the Type as prompted. After completing the configuration for the current row, click the icon to save.
   	Quick Mapping	Based on the upstream input and the fields of the target table, you can manually select field mapping. Quick Mapping includes Same Row Mapping and Same Name Mapping. Same Name Mapping: Maps fields with the same field name. Same Row Mapping: Maps fields in the same row position when source and target field names differ.

9. Click OK to complete the property configuration of the Vertica output component.