The LogicalTable input widget reads data from logical fact tables, logical dimension tables, and logical aggregate tables in Dataphin. To sync data from logical tables to a data source, you must configure the logical table information first.
Prerequisites
Before you begin, make sure that:
-
The current project is bound to an offline computing engine. For more information, see Create a general project.
-
A logical table has been created. For more information, seeStandardized Modeling.
-
To configure the LogicalTable input widget, the account must have read-through permissions for the data table. If the account lacks these permissions, request them first. For more information, see Request, renew, and release table permissions.
Procedure
-
On the Dataphin home page, select Development > Data Integration from the top menu bar.
-
On the integration page, select Project from the top menu bar (ensure the environment is set to Dev-Prod mode).
-
In the left-side navigation pane, click on the Batch Pipeline icon. From the Batch Pipeline list, select the offline pipeline you want to develop to access its configuration page.
-
Click Component Library in the upper-right corner of the page to open the Component Library panel.
-
In the left-side navigation pane of the Component Library panel, select Input. Then, in the input widget list on the right, locate the Logicaltable input widget and drag it onto the canvas.
-
Click the
icon on the LogicalTable input widget card to open the Logicaltable Input Configuration dialog box. -
In the Logicaltable Input Configuration dialog box, set the parameters.
Parameter
Description
Step name
The name of the LogicalTable input widget. Dataphin automatically generates a step name, which you can modify as needed. The naming conventions are as follows:
-
Only Chinese characters, letters, underscores (_), and digits are allowed.
-
The name cannot exceed 64 characters.
Data block
Select the data block where the logical table resides.
Logical table type
Select the type of the logical table: logical fact table, logical dimension table, or logical aggregate table.
For more information, see Standardized modeling.
Logical table
Based on the selected logical table type, select the corresponding logical table.
The drop-down list shows only the logical tables for which the current account has read-through permissions. You can add other logical tables in the following ways:
-
If you do not have permissions for a logical table, request them first. For more information, see Request, renew, and release table permissions.
-
To create a new logical table, click Create and follow the instructions. For more information, see Standardized modeling.
Logical table output
You can select With associations or Without associations.
-
With associations: Outputs the associated tables of the current logical table.
-
Without associations: Outputs only the content of the selected logical table.
Output fields
Displays all fields read from the logical table. You can click the Actions column's
icon to delete a field.On the Field Management page, all fields are selected by default and displayed in the output fields preview area.
If you select an associated table node, all tables under that node are selected. You can select specific tables and then click Invert Selection to select the remaining ones.
To remove a field from the output fields preview area, deselect it in the all fields display area.
-
-
Click Confirm to finalize the configuration of the LogicalTable input widget.