Manage resource queues

更新时间:
复制 MD 格式

Each workspace includes two default queues, dev_queue and root_queue, for running jobs. If you need to isolate and manage resources, you can create additional resource queues. This topic describes how to manage resource queues.

Prerequisites

You have created a workspace. For more information, see Manage workspaces.

Create a queue

Note

You can isolate and manage resources by adding queues. If you do not add new resource queues, you can use the default dev_queue and root_queue to run jobs. If you purchase a subscription quota, the system automatically creates a subscription_queue queue.

  1. Go to the Resource Management page.

    1. Log on to the E-MapReduce console.

    2. In the navigation pane, choose EMR Serverless > Spark.

    3. On the Spark page, click the name of the target workspace.

    4. On the EMR Serverless Spark page, click Resource Management in the navigation pane.

  2. On the Queue Resources tab, click Create Queue.

  3. In the Create Queue dialog box, configure the parameters based on your workspace's billing method, and then click OK.

    Pay-as-you-go

    Parameter

    Description

    Queue Name

    The queue name must be unique within the workspace.

    Note

    You cannot change the Queue Name after the queue is created.

    Auto Maximum Concurrency (CU)

    Specifies the maximum number of compute units (CUs) that can run concurrently in the queue. Based on the configuration of your session instances, set this value to at least 3 for the selected deployment queue.

    To adjust the concurrency limit for other queues, see Adjust queue resources.

    Application Environment

    • Development: Recommended for non-critical workloads, such as development and testing.

    • Production: Recommended for business-critical workloads that require stable, efficient, and secure service.

    Subscription

    Parameter

    Description

    Queue Name

    The queue name must be unique within the workspace.

    Note

    You cannot change the Queue Name after the queue is created.

    Fixed Resource Quota (CU)

    The maximum number of CUs you can allocate depends on the remaining subscription quota in the workspace. If the quota is insufficient, you can:

    Application Environment

    • Development: Recommended for non-critical workloads, such as development and testing.

    • Production: Recommended for business-critical workloads that require stable, efficient, and secure service.

    Hybrid Billing

    Parameter

    Description

    Queue Name

    The queue name must be unique within the workspace.

    Note

    You cannot change the Queue Name after the queue is created.

    Auto Maximum Concurrency (CU)

    Specifies the maximum number of compute units (CUs) that can run concurrently in the queue. Based on the configuration of your session instances, set this value to at least 3 for the selected deployment queue.

    To adjust the concurrency limit for other queues, see Adjust queue resources.

    Fixed Resource Quota (CU)

    The maximum number of CUs you can allocate is determined by the remaining subscription quota in the workspace. If the quota is insufficient, you can adjust the resource allocation of other queues.

    For more information, see Adjust queue resources.

    Application Environment

    • Development: Recommended for non-critical workloads, such as development and testing.

    • Production: Recommended for business-critical workloads that require stable, efficient, and secure service.

Edit a queue

Adjust queue resources

The steps vary depending on your workspace's billing method.

Pay-as-you-go

  1. On the Queue Resources tab of the Resource Management page, find the target queue and click Edit Queue in the Actions column.

  2. In the Edit Queue dialog box, on the Resources tab, adjust the value for Auto Maximum Concurrency (CU).

  3. Click OK.

Subscription

  1. On the Queue Resources tab of the Resource Management page, find the target queue and click Edit Queue in the Actions column.

  2. In the Edit Queue dialog box, on the Resources tab, adjust the value for Fixed Resource Quota (CU).

  3. Click OK.

Hybrid Billing

  1. On the Queue Resources tab of the Resource Management page, find the target queue and click Edit Queue in the Actions column.

  2. In the Edit Queue dialog box, on the Resources tab, adjust the values for Fixed Resource Quota (CU) and Auto Maximum Concurrency (CU).

  3. Click OK.

Edit queue permissions

  1. On the Queue Resources tab of the Resource Management page, find the target queue and click Edit Queue in the Actions column.

  2. In the Edit Queue dialog box, click the Permission tab.

  3. You can add or remove users, and modify their permissions.

  4. Click OK.

Delete a queue

Important
  • You cannot delete the root_queue.

  • Before you delete a resource queue, ensure that no running or pending jobs in the workspace are associated with it. Deleting a queue that is in use affects all associated jobs.

  1. On the Queue Resources tab of the Resource Management page, find the target queue and click Delete in the Actions column.

  2. In the Delete Queue dialog box, click Delete Queue.

References