Create a custom resource group

Updated at:

can achieve unified allocation and management of schedule resources through resource group configuration. This topic will introduce how to create a custom resource group.

Limits

can create up to 100 resource groups, including the default resource group.

Note

The number of resource groups does not distinguish between resource group statuses.

Permission description

Custom roles with Manage Resource Settings permission and system roles including super administrator and system administrator can create custom resource groups.

Procedure

  1. On the Dataphin home page, select Management Center > System Settings from the top menu bar.

  2. In the left-side navigation pane, select Tenant Settings > Resource Settings.

  3. Under the Resource Group Configuration tab, click + Create Custom Resource Group.

  4. In the Create Custom Resource Group dialog box, configure the parameters.

    Parameter

    Description

    Resource Group Name

    Enter the resource group name. Up to 128 characters are supported.

    Owner

    Select the owner of the current resource group. You can enter a username keyword to search.

    Cluster

    Select the cluster to which the resource group belongs. You can choose the , public schedule cluster, or a custom cluster available to the current tenant (that is, a cluster associated with all tenants or specified for the current tenant).

    Note

    The cluster cannot be modified after creation.

    Schedule Resource Settings

    • CPU and Memory: Configure the CPU and Memory with the Active Upper Limit and Active Lower Limit respectively.

      • When the cluster is selected as public schedule cluster:

        • Available lower limit: Available lower limit = percentage (%) * available amount. Users need to enter a percentage number, accurate to one decimal place, default is empty. Remaining resources = 1 - the total allocated to other resource groups from the current tenant's resource lower limit (percentage). The available lower limit cannot exceed the remaining resources.

        • Available upper limit: Available upper limit = percentage (%) * available amount. Users need to enter a percentage number, accurate to one decimal place, default is 100%. The available upper limit cannot be lower than the available lower limit.

      • When the cluster is selected as registered external cluster:

        • Available lower limit: Available lower limit = percentage (%) * total cluster amount. Users need to enter a percentage number, accurate to one decimal place, default is empty. Remaining resources = 1 - the total allocated to other resource groups from the total cluster amount (percentage), where the total cluster amount is the total amount of the selected cluster in the above configuration. The available lower limit cannot exceed the remaining resources.

        • Available upper limit: Available upper limit = percentage (%) * total cluster amount. Users need to enter a percentage number, accurate to one decimal place, default is 100%. The available upper limit cannot be lower than the available lower limit.

      Note
      • The available lower limit represents the guaranteed resources of the current resource group. When tenant resources are tight, all resource groups are prioritized to obtain the set lower limit.

      • The unused lower limit of this resource group can be borrowed by other resource groups of the current tenant. However, when this resource group needs to use it, the borrowed resources can be reclaimed through queuing.

      • This resource group can also borrow unused resource quotas from other resource groups of the current tenant. However, the total amount of resources available after borrowing cannot exceed the set available upper limit.

      • Resource groups can only borrow resources from resource groups originating from the same cluster.

    • Description: Enter a brief description of the current resource group, not exceeding 1000 characters.

    • Scenario:

      Includes daily scheduling and batch operations for offline tasks.

      • Batch operations: Resource groups that can be selected for batch operations, such as batch data backfill. The resource group configured for batch operations is only effective for the instances covered by the batch operation.

      • Task daily scheduling: Refers to the resource group used for task trial runs, smoke testing, recurring schedules, and other operations. It is necessary to configure the associated projects that can use the current resource group. After configuration, in the project configuration, you can select the associated resource group as the project's default resource group. For more information, see the referenced document.

      For the priority of resource group effectiveness, see the referenced document.

  5. Click OK to complete the custom resource group configuration.

    The modified configuration of the resource group may take some time to take effect (approximately 5 minutes). Please be patient.