DataWorks console

更新时间:
复制 MD 格式

The DataWorks console is a centralized, visual interface for managing workspaces, resource groups, and purchased resources. It provides one-click access to modules that help you perform data development, integration, O&M, and manage the performance of data services.

Pages

You can view the following information in the DataWorks console.

Page

Description

Overview

View recently used workspaces, configure workspace settings, and get the latest product updates and news.

Workspaces

View all workspaces created under your tenant, create new workspaces, or manage the workspaces that you have joined.

Resource groups

View and manage all resource groups under your account, or create new ones.

Image management

View custom images created under your account. You can create a custom image, publish it, and then use it in DataStudio.

Purchased resources and services

View and manage the services and resource groups purchased under your account.

Functional modules

Learn about the features and workflows of each DataWorks module and quickly access a specific module within a workspace.

Compute engines

Quickly navigate to the console of each compute engine to perform O&M.

Alert configuration

View alert resources under your account in a specific region and set daily limits for alert notifications sent by text messages and phone calls.

Open Platform

Quickly integrate various application systems with DataWorks from the Open Platform page.

Data lake integration (Data Lakehouse)

Build a unified data management platform that integrates a data lake with a data warehouse.

Notes

  • If you cannot view features or encounter errors as a RAM user, verify that you have the required permissions. For more information, see RAM policy for product and console permissions.

  • DataWorks workspaces and resource groups are region-specific. Ensure you select the correct region before proceeding.

Overview page

Log on to the DataWorks console. The Overview page, which appears by default, shows DataWorks use cases, provides shortcuts to frequently used workspaces, and displays product news.

Workspaces

In the left-side navigation pane of the console, click Workspace to view all workspaces within your tenant in the selected region. You can also manage the workspaces you have joined or create new ones.

Note

If you log on as a RAM user, you can only view basic information about workspaces that you have not joined. You cannot view detailed metrics or perform management operations on these workspaces. To view the details of a workspace, you must be added as a member of that workspace. For more information, see Add members to a workspace.

Operation

Description

References

Select a region

Switch the region for DataWorks. The list of workspaces is region-specific.

-

Create a workspace

In Area ②, you can create a new DataWorks workspace.

Configure a workspace.

View basic information about a workspace

Area ③ displays basic information about a workspace, such as its mode and administrator. Key information includes:

  • Tags: A tag is a key-value pair used to label and organize your Alibaba Cloud resources.

  • Mode: The current mode of the workspace. DataWorks supports basic mode and standard mode. Standard mode is recommended for production.

  • Administrator: The administrator of the workspace. The administrator can add RAM users to the workspace on the Management Center > Workspace > Workspace Members page.

  • Resource Group ID: The resource group to which the workspace belongs. This is the Shared Resource Group that you created in Alibaba Cloud Resource Management.

    Important

    The resource group displayed here is a mechanism for managing and grouping resources under an Alibaba Cloud account to simplify the complexity of resource grouping and authorization management. This concept differs from the DataWorks resource groups used for running nodes. For more information about Alibaba Cloud resource groups, see What is Resource Management?

Workspace operations

In Area ④, you can view key metrics for the current workspace, quickly access modules, or perform workspace-related operations.

  • Details: View the instance status from the previous day, governance issues, and workspace model and metric data.

  • Shortcuts: Quickly navigate to functional modules related to the current workspace.

  • Manage: Go to SettingCenter to configure the workspace and manage member roles, data sources, clusters, and extensions.

  • Create data source: Go to DataStudio to create and bind a data source for code development.

  • Delete workspace: Delete a workspace. A deleted workspace cannot be restored.

  • Disable workspace: If you no longer need DataWorks, you can disable the workspace. After a workspace is disabled, its nodes are no longer scheduled. However, its compute engine resources may still exist and incur fees.

Upgrade edition

In Area ⑤, you can upgrade your current DataWorks edition.

  • Upgraded editions provide more features. The capabilities of each edition vary.

  • Upgraded editions are activated at the region level. After purchase, all workspaces in the current region can use the features of that edition.

For more information about the differences between DataWorks editions, see DataWorks editions and features.

Purchase an exclusive resource group

In Area ⑤, you can purchase an exclusive Serverless resource group. After the purchase, click Resource Group in the left-side navigation pane to view the details of the resource group.

For more information about resource groups, see Overview of DataWorks resource groups.

Resource groups

In the left-side navigation pane of the console, click Resource Group to purchase resources, and manage purchased resources in the selected region.

Operation

Description

References

Create a resource group

Use this area to create a new Serverless resource group.

For more information about resource groups, see Overview of DataWorks resource groups.

View basic information about a resource group

View basic information about a resource group, such as its running status, expiration time, and usage.

  • Area ②, resource group Status:

    • Starting: The resource group is starting up after purchase. Please wait.

    • Running: The resource group is operational and can run nodes.

    • Updating: The resource group is being modified. For example, it is being scaled.

      Note

      The update process may take some time. Please wait.

    • Expired: If a subscription resource group is not renewed upon expiration, its status changes to Expired and it can no longer be used. If it is still not renewed after a period of time, the resource group record is deleted from the console.

  • Area ③, resource group usage: High resource group usage can affect node execution speed. You should check the resource consumption of specific nodes and adjust usage as needed.

Basic operations on a resource group

View detailed information about a resource group and make changes.

  • Details: View basic information, resource usage, concurrent scheduling usage, and resource usage across modules like Data Integration, data computing, DataService Studio, data scheduling, and personal development environments.

  • Network Settings: To access a specific network, you must configure it for the resource group. First, select a network connectivity solution and follow the setup instructions in the documentation.

  • Bind Workspace: A purchased resource group must be bound to a workspace before use.

    You need the ModifyResourceGroup permission to change the associated workspace. For information about how to grant the permission, see Fine-grained console permission control: custom policies.

  • More Operations: Click the image icon to perform operations such as scaling, renewing, unsubscribing, managing quotas, and modifying the data scheduling concurrency limit for the resource group.

Note

Changes to a resource group may take some time. Please wait.

Image management

In the left-side navigation pane, click Image Management to view official DataWorks images. If a node on a Serverless resource group requires a specific environment, such as third-party libraries, create a custom image with the necessary dependencies. When running the node, specify the Serverless resource group for execution and select the custom image as the runtime environment. For more information, see Custom images.

Purchased resources and services

In the left-side navigation pane, click Purchased Resources and Services. On this page, you can view details of your purchased subscription and pay-as-you-go DataWorks services and resource groups. You can also view related bills and billing rules, or perform operations such as renewal, upgrade, downgrade, and unsubscription. For more information, see View bill details and Billing overview.

Modules

You can use the console to learn about the features and workflows of DataWorks modules and access modules in a workspace, such as Data Integration, Data Modeling, DataStudio, Operation Center, Data Quality, Data Analysis, Data Map, Security Center, Data Governance Center, DataService Studio, and SettingCenter, to perform operations.

Take the Data Integration module as an example. In the left-side navigation pane, expand the Data Development & Governance menu and click Data Integration. In the main content area, select a target workspace and click Go to Data Integration. The Data Integration workflow includes selecting data sources, choosing a resource group, creating a synchronization node, setting a frequency, mapping tables and fields, configuring advanced parameters, setting up alerts, and finally, running and maintaining the node.

Compute engines

In the left-side navigation pane, click Computing Resources to go to the console of each compute engine to perform O&M.

Engine

Description

References

MaxCompute

Quickly navigate to MaxCompute project management to configure, view, and manage MaxCompute projects.

Project management

Hologres

Quickly navigate to the Hologres console to manage Hologres instances.

Hologres console

AnalyticDB for MySQL

Quickly navigate to the AnalyticDB for MySQL console to create and maintain clusters, and perform data development and other management operations.

AnalyticDB for MySQL cluster management

AnalyticDB for PostgreSQL

Quickly navigate to the AnalyticDB for PostgreSQL console to manage AnalyticDB for PostgreSQL instances.

AnalyticDB for PostgreSQL instance management

Alert configuration

In the left-side navigation pane, click Others > Alarm resources or Others > Alarm contact to view and configure DataWorks alert contacts and set alert limits.

Page

Description

References

Alert resources

This page displays the alert resource usage for the current day and the current month. You can also set upper limits on the number of alerts.

Important
  • The alert limits that you set take effect only in the current region.

  • After the alert limits are reached, you no longer receive alert text messages or phone calls.

View and set alert resources.

Alert contacts

On this page, you can configure contact information for DataWorks alert contacts. You can synchronize contact settings from RAM with one click or manually configure contacts.

Note

Contacts must be activated to take effect after they are synchronized or configured.

View and configure alert contacts

Open Platform

In the left-side navigation pane, click More > Open Platform to go to the DataWorks Open Platform page. Open Platform provides data and capabilities to external systems. It helps you integrate applications, manage workflows, and respond to status changes in those applications.

Module

Description

References

OpenAPI

This page displays the current number of API calls. You can call DataWorks OpenAPI operations to use various features and enable integration and interaction between your applications and DataWorks.

OpenAPI

OpenEvent

OpenEvent is an open messaging capability provided by DataWorks. DataWorks publishes its internal state changes as messages that external systems can subscribe to, enabling custom integrations.

OpenEvent

Extensions

DataWorks allows you to register your services as DataWorks Extensions. In combination with the OpenEvent message push mechanism, extensions can receive messages and manage workflows for specific events in DataWorks. You can also use this mechanism for custom, business-specific development.

Extensions

Data lake integration (Data Lakehouse)

Alibaba Cloud's Data Lakehouse uses MaxCompute as the data warehouse and a Hadoop platform or Object Storage Service (OSS) as the data lake, forming a "one warehouse, multiple lakes" architecture. This model breaks down silos by combining the flexibility of data lakes with the robust capabilities of data warehouses, resulting in a unified data management platform. For more information, see Overview of the MaxCompute Data Lakehouse.