The data catalog feature in DataWorks lets you synchronize data from a single MaxCompute table to a Hologres internal table, enabling more efficient big data analysis and real-time queries. This topic describes how to configure this data synchronization, allowing you to easily migrate your data and leverage the high-performance query capabilities of Hologres.
Background
This feature synchronizes data from a MaxCompute internal table to a Hologres internal table in two steps. First, the system imports the data into a Hologres foreign table by using the IMPORT FOREIGN SCHEMA command. Then, it synchronizes the data from the foreign table to the Hologres internal table.
Prerequisites
-
You have created a MaxCompute project and a Hologres instance.
-
You have bound the MaxCompute project and the Hologres instance to a DataWorks workspace as computing resources and confirmed that they passed the connectivity test.
Limitations
The source MaxCompute table must exist before you can create a foreign table and read data from it.
Entry point
Follow these steps to open the configuration page for synchronizing data from MaxCompute to Hologres.
-
Go to the Workspaces page in the DataWorks console. In the top navigation bar, select a desired region. Find the desired workspace and choose in the Actions column.
-
In the left-side navigation pane, click the
icon to open the Data Directory pane. -
In the left-side directory tree, expand MaxCompute and find the internal Table that you want to synchronize. Right-click the table and select Data Synchronization to Hologres.
-
Select the path to which the node is created, and click Confirm.
-
In the dialog box that appears, enter a name for the synchronization task and press Enter. The configuration page for synchronizing data from MaxCompute to Hologres appears.
Configure the node task
On the configuration page, configure the Data Synchronization to Hologres node as required.
The system automatically populates the parameters in the MaxCompute Source table selection section from the internal table you selected. Manual configuration is not required.