Manage compute resource groups

Prerequisites

The Lindorm Compute Engine must be activated. For more information, see Activate Lindorm Compute Engine.

Create and manage resource groups

1. Log on to the Lindorm console. In the upper-left corner of the page, select the region of the instance. On the Instances page, click the ID of the target instance or click View Instance Details in the Actions column for the instance.

2. On the Instance Details page, go to the Configurations section. In the row for Compute Engine, click Resource Groups in the Actions column.

3. On the Resource Group Details page, click Create Resource Group and configure the following parameters:

   • Resource Group Name: The name of the resource group. The name can contain only lowercase letters and digits and must be no more than 63 characters in length. For example, cg0.

   • Resource Group Type: The supported types are ETL resource group and OLAP resource group.

   • Other configuration items:

     ETL resource group

     An ETL resource group is designed for production workloads in data lake or data warehouse environments. It provides high-throughput computing capabilities for large datasets and features an elastic computing resource pool that scales on demand.

     Parameter	Description	Example
     Daily Resource Quota (DAILY_QUOTA)	The maximum number of capacity units (CUs) that the resource group can consume per day. The unit is CU*Hour. The default value is 100000. Important Exceeding the quota immediately terminates jobs. For resource groups that require high stability, you can set this parameter to 0 for no limit.	{ "MAX_CPU": "2000", "MAX_MEM": "16000G" }
     The maximum number of CPU cores in the resource group. (MAX_CPU)	The maximum number of CPU cores for the resource group. Valid values: [100, 100000].
     The maximum memory size in the resource group. Unit: GB. (MAX_MEM)	The maximum memory size for the resource group, in GB. Valid values: [400G, 1000000G]. No default value is provided. Note When you configure the property MAX_MEM, use G as the unit. For example, 16000G.
     Authorize Users	The access permissions for the resource group. The default value is *, which allows all users to access the resource group.

     OLAP resource group

     An OLAP resource group is optimized for analytical queries. It is ideal for low-latency queries on datasets smaller than 100 GB and can handle high concurrency.

     Parameter	Description
     Node Specifications	Select a node type.
     Working Nodes in Job (WORKERS)	The number of worker nodes for a job. Each node has 8 vCPUs and 64 GB of memory. Valid values: [4, 1024]. The default value is 4. Example: { "WORKERS": "4" }

     Note

     • After you activate the Lindorm Compute Engine, a default ETL resource group named default is automatically created.

     • For the default resource group, you can only modify its properties. You cannot delete or restart it.

4. On the Resource Group Details page, you can Edit, Delete, or Restart a resource group that you created.

Using resource groups

The following sections describe how to use ETL and OLAP resource groups.