Resource groups let centrally allocate and manage scheduling resources. You can create up to 100 resource groups per tenant, including the default one.
Limits
can create up to 100 resource groups, including the default resource group.
Resource group count is independent of resource group status.
Permissions
Custom roles with Manage Resource Settings permission and system roles including super administrator and system administrator can create custom resource groups.
Procedure
-
On the Dataphin home page, select Management Center > System Settings from the top menu bar.
-
In the left-side navigation pane, select Tenant Settings > Resource Settings.
-
Under the Resource Group Configuration tab, click + Create Custom Resource Group.
-
In the Create Custom Resource Group dialog box, configure the parameters.
Parameter
Description
Resource Group Name
The resource group name. Up to 128 characters.
Owner
The owner of the resource group. You can search by username.
Cluster
The cluster that the resource group belongs to. You can choose the , public schedule cluster, or a custom cluster available to the current tenant (a cluster associated with all tenants or specified for the current tenant).
NoteThe cluster cannot be modified after creation.
Schedule Resource Settings
-
CPU and Memory: Set the CPU and Memory with the Active Upper Limit and Active Lower Limit respectively.
-
When the cluster is selected as public schedule cluster:
-
Available lower limit: Available lower limit = percentage (%) * available amount. Enter a percentage accurate to one decimal place. The default is empty.
Remaining resources = 1 - the total allocated to other resource groups from the current tenant's resource lower limit (percentage). The available lower limit cannot exceed the remaining resources. -
Available upper limit: Available upper limit = percentage (%) * available amount. Enter a percentage accurate to one decimal place. The default is 100%. The available upper limit cannot be lower than the available lower limit.
-
-
When the cluster is selected as registered external cluster:
-
Available lower limit:
Available lower limit = percentage (%) * total cluster amount. Enter a percentage accurate to one decimal place. The default is empty.Remaining resources = 1 - the total allocated to other resource groups from the total cluster amount (percentage), where the total cluster amount is the total amount of the selected cluster in the above configuration. The available lower limit cannot exceed the remaining resources. -
Available upper limit:
Available upper limit = percentage (%) * total cluster amount. Enter a percentage accurate to one decimal place. The default is 100%. The available upper limit cannot be lower than the available lower limit.
-
Note-
The available lower limit represents guaranteed resources for the resource group. When tenant resources are tight, each resource group is prioritized to receive its configured lower limit.
-
Unused lower-limit resources of this resource group can be borrowed by other resource groups within the same tenant. When this resource group needs those resources back, borrowed resources are reclaimed through queuing.
-
This resource group can also borrow unused quotas from other resource groups within the same tenant, but the total resources after borrowing cannot exceed the configured available upper limit.
-
Resource groups can only borrow resources from other resource groups in the same cluster.
-
-
Description: A brief description of the resource group. Maximum 1000 characters.
-
Scenario:
Includes daily scheduling and batch operations for offline tasks.
-
Batch operations: Resource groups available for batch operations such as batch data backfill. A resource group configured for batch operations applies only to the instances covered by that batch operation.
-
Task daily scheduling: The resource group used for task trial runs, smoke testing, recurring schedules, and other operations. You must configure the associated projects that can use the resource group. After configuration, you can select the associated resource group as the project's default resource group in project settings. For more information, see the referenced document.
For resource group priority rules, see the referenced document.
-
-
-
Click OK to complete the custom resource group configuration.
Resource group configuration changes may take approximately 5 minutes to take effect.