The Table Management feature lets you define identifiers for table partition fields, temporary tables, and import tables. This helps you categorize tables by name. You can also define folders and layers to group and manage tables by dimensions such as function and type.
Limitations
Only a Workspace Administrator or Project Owner can configure table formats, folders, and layers. To grant the required permission, see Add members and grant permissions.
Access table management
Log on to the DataWorks console. In the target region, click in the left-side navigation pane. Select a workspace from the drop-down list and click Go to Data Development.
-
Go to the Table Management page.
In the lower-left corner of the DataStudio page, click the Settings icon. On the Settings page that appears, click the Table Management tab. On this tab, you can:
-
Define table formats. For more information, see Define table formats.
-
Define folders. For more information, see Define folders.
-
Define layers. For more information, see Define layers.
-
Define table formats
On the Table Management page, you can configure formats such as table partitions and prefixes to help categorize tables by name. DataWorks provides default formats and prefixes that you can customize to meet your business needs.
Only a Workspace Administrator or Project Owner can define table formats. To grant the required permission, see Add members and grant permissions.
The following table describes the parameters.
|
Parameter |
Description |
|
Partition date format |
The date format for table partitions. The default value is YYYYMMDD. |
|
Partition field name |
The name of the partition field. We recommend that you use dt. |
|
Temporary table prefix |
Specifies the prefix for temporary tables. The default is t_. Tables with this prefix are excluded from automatic parsing. |
|
Import table prefix |
Specifies the prefix for tables uploaded or imported to DataStudio. Example: upload_. |
Define folders
In DataWorks, folders act as directories to organize and manage tables within a workspace. You can create custom folders based on various dimensions, such as table purpose or type, to group and manage similar tables.
-
Define a folder
Note-
Permissions
Only a Workspace Administrator or Project Owner can add or manage folders. To grant the required permission, see Add members and grant permissions.
-
Create a folder
If you select Root Folder as the parent folder, a top-level folder is created. If you select an existing folder as the parent, a subfolder is created. A maximum of two folder levels are supported.
On the Folders tab, enter a folder name in the Folder Name field, select a parent folder from the Parent Folder drop-down list, and then click Add.
-
-
What to do next
-
When you create a table, you can assign it to a folder. For more information about how to create different types of tables, see the following topics:
Table type
Related documentation
MaxCompute
AnalyticDB for PostgreSQL
E-MapReduce
Hologres internal table
Hologres external table
-
When you query table data on the Table Management page, you can filter tables by folder. For more information, see Manage tables in DataStudio.
-
Define layers
Layer management in DataWorks lets you design table layers and categories. These classifications are for management purposes only and do not affect underlying logic or implementation.
Only a Workspace Administrator or Project Owner can add or manage table layers and categories. To grant the required permission, see Add members and grant permissions.
-
Concepts
Concept
Description
Table layer
Data warehouse layering is the process of designing the overall architecture and detailed physical division of a data model based on a comprehensive analysis of business scenarios, actual data, and system usage.
Typically, you can divide tables into layers based on the data warehouse layering model:
-
Operational data store (ODS)
-
Dimension (DIM)
-
Data warehouse detail (DWD)
-
Data warehouse summary (DWS)
-
Application data service (ADS)
Classifying data into layers based on purpose improves data organization, management, and maintenance. You can also customize table layers to meet your business needs.
Category
A finer-grained, business-oriented classification of tables, such as by basic or advanced business domains.
You can also customize categories to meet your business needs.
-
-
Define layers and categories
On the Layers tab, in the Table Layer Configuration section, enter a Table Layer name and a Layer Description, and then click Add. In the Physical Category section, enter a Category Name and a Category Description, and then click Add. You can Modify or Remove existing entries.
-
What to do next
After defining table layers and categories, you can assign tables to them during creation. For more information about how to create tables, see the following topics:
Table type
Related documentation
MaxCompute
AnalyticDB for PostgreSQL
E-MapReduce
Hologres internal table
Hologres external table