Configure TDengine input widget

Prerequisites

Before beginning the operation, ensure the following tasks have been completed:

• A TDengine data source has been created. For more information, see create TDengine data source.

• To configure the TDengine input widget properties, the account must possess read-through permission for the data source. If permission is lacking, you must request access to the data source. For more information, see request, renew, and return data source permissions.

Procedure

1. On the Dataphin home page, select Development > Data Integration from the top menu bar.

2. On the integration page, select Project from the top menu bar (Dev-Prod mode requires selecting an environment).

3. In the left-side navigation pane, click Batch Pipeline. In the Batch Pipeline list, click the offline pipeline you want to develop to open its configuration page.

4. Click Component Library in the upper right corner of the page to open the Component Library panel.

5. In the Component Library panel's left-side navigation pane, select Input. Find the TDengine component in the input widget list on the right and drag it to the canvas.

6. Click the icon in the TDengine input widget card to open the TDengine Input Configuration dialog box.

7. In the TDengine Input Configuration dialog box, configure the parameters.

   Parameter	Description
   Step Name	This is the name of the TDengine input widget. Dataphin automatically generates the step name, but you can modify it according to the business scenario. The name must meet the following requirements: Can only contain Chinese characters, letters, underscores (_), and numbers. Cannot exceed 64 characters.
   Datasource	The data source drop-down list displays all TDengine-type data sources in the current Dataphin, including data sources for which you have read-through permission and those for which you do not. Click the icon to copy the current data source name. For data sources without read-through permission, you can click Request after the data source to request read-through permission. For more information, see request, renew, and return data source permissions. If you do not yet have a TDengine-type data source, click Create Data Source to create a data source. For more information, see create TDengine data source.
   Database (optional)	Select the database where the table is located. If not filled in, the database specified during data source registration will be used.
   Table	You can enter table name keywords to search or enter the exact table name and click Exact Search. After selecting a table, the system will automatically detect the table status. Click the icon to copy the name of the currently selected table.
   Shard Key (optional)	The system shards data based on the configured shard key field, which can be used in conjunction with concurrent degree configuration to achieve concurrent reading. It supports using a column in the source data table as the shard key. Additionally, it is recommended to use the primary key or indexed column as the shard key to ensure transmission performance. Important When selecting a date-time type, the system will perform brute-force sharding based on the total time range and concurrent degree by identifying the maximum and minimum values. No guarantee of average distribution.
   Batch Read Count (optional)	The number of records read at one time. When reading data from the source database, you can configure a specific batch read count (such as 1024 records) instead of reading one by one to reduce the number of interactions with the data source, improve I/O efficiency, and reduce network latency.
   Input Filter (optional)	Fill in the condition expression supported by the TDengine database. Only fill in the content after the where keyword. Do not fill in the where keyword. Support using system global variables, such as data timestamp ${bizdate}.
   Output Fields	The output fields area displays all fields hit by the selected table and filter conditions. You can drag the icon to adjust the field order. If you do not need to output certain fields to downstream widgets, you can delete the corresponding fields. Single Field Deletion Scenario: If you need to delete a small number of fields, you can click the icon under the operation column to delete the extra fields. Batch Field Deletion Scenario: If you need to delete many fields, you can click Field Management, select multiple fields in the Field Management dialog box, click the left shift icon to move the selected input fields to unselected input fields, and click Confirm to complete the batch field deletion.

8. Click Confirm to finalize the property configuration for the TDengine input widget.