EAS resource groups
PAI-EAS provides two types of resource groups: dedicated resource groups and virtual resource groups. Dedicated resource groups let you purchase and manage exclusive computing resources. Virtual resource groups combine multiple resource types — public resources, resource quotas, and dedicated EAS resources — to support mixed deployment of services.
Dedicated resource groups
Resource types
Dedicated resources are available in two billing modes: subscription (prepaid) and pay-as-you-go (postpaid).
Type | Billing method | Resource group management | Supported resource types |
Prepaid resource | Subscription | Purchase machines, renew prepaid machines, release postpaid machines, and delete resource groups. For more information, see Manage machines in a dedicated resource group. | Go to the EAS Dedicated Machine Subscription page. |
Postpaid resource | Pay-as-you-go | Go to the EAS Dedicated Machine Pay-as-you-go page. |
Postpaid dedicated resources are billed immediately after purchase, regardless of whether they're used to deploy services. Release unused postpaid machines promptly to avoid unnecessary charges.
Create a dedicated resource group
Go to the AI Computing Resources > Resource Pools page and select the EAS Inference Resources tab.
On the Dedicated Resource Group tab, click Create Resource Group and select one of the following options:
Create Resource Group: Creates only the resource group. You then purchase machines from the resource group details page.
Create Resource (Subscription) or Create Resource (Pay by Usage): Redirects to the buy page where you purchase machines and create the resource group at the same time.
On the buy page, configure the following parameters.
Parameter
Description
Billing Method
Select Subscription or Pay-as-you-go.
Region and Zone
Select the region and zone for the resource group.
Node Type
Available GPU and CPU instance types. For the full list of available resources, see the EAS Dedicated Machine Subscription or EAS Dedicated Machine Pay-as-you-go page.
NoteAvailable instance types vary by region.
System Disk
Each machine includes 200 GB of system disk storage at no additional cost. You can increase the capacity to up to 2,000 GB (minimum: 200 GB). For billing details on extra capacity, see EAS billing.
NoteAll service instances share the system disk storage. When the system disk runs low, the system evicts service instances to free up space, starting with those that use the most storage. To read from or write to a local disk directory during instance runtime, see Storage mounts.
buy_type
Select new or upgrade.
If you select upgrade, configure the resource_id.
resource_id
Select a created resource group ID from the list.
order_num
Valid values: 1 to 9999.
Duration
Subscription periods: 1 month, 2 months, 3 months, 6 months, 1 year, or custom durations (subscription only).
Auto-Renewal
Enable or disable auto-renewal when the subscription expires (subscription only).
After the payment succeeds, the system allocates resources automatically. You can view or rename your resource groups on the Resource Group tab.
Note(Subscription only) If the resource group fails to be created due to insufficient resources in the selected region, the system automatically creates a refund order and the payment is returned through the original payment channel.
Manage machines in a dedicated resource group
Purchase machines |
|
Renew a machine (Subscription machines only) | Extend the subscription period of a machine. For example, renewing for one month extends the subscription by one month.
|
Release a machine | Postpaid machine: On the dedicated resource group details page, click Delete in the Operations column of the target instance. Subscription machine: See EAS FAQ. |
View resource usage | On the Resource Group tab, click the target resource group name. Then on the Nodes tab, view the CPU, GPU, and memory usage and total capacity of each machine. |
Disable scheduling | When a machine is in the Running state, click Stop Scheduling in the Actions column to make the machine unschedulable. Click Restart Scheduling to resume scheduling. Note After scheduling is disabled, services already running on the machine continue to run. However, if a service is restarted, it's scheduled to another available machine in the resource group. |
Evacuate node | Click Clear Node. Service instances deployed on the machine are automatically stopped and redeployed to other available machines in the resource group. Important Evacuating a node aborts all running jobs on the machine. Proceed with caution. |
Virtual resource groups
A virtual resource group is a logical grouping that combines multiple resource types — public resources, resource quotas, and dedicated EAS resources — so that you can deploy and schedule a single service across different resource pools.
Create a virtual resource group
Go to the AI Computing Resources > Resource Pools page and select the EAS Inference Resources tab.
On the Virtual Resource Group tab, click Create Virtual Resource Group.
The supported resource types include Public Resource Group, EAS Resource Group, and Resource Quota. For public resource groups, you can also select Spot instances. Configure the resource types as needed and set the scheduling priority for each resource (1 = lowest priority, 9 = highest priority).
Use a virtual resource group
When you deploy a service, in the Resource Information section, set Resource Type to EAS Resource Group and then select the Virtual Resource Group from the Resource Group drop-down list.
References
For more information about model service deployment configuration, see Custom deployment.
You can configure log collection for resource groups to save EAS service logs to your SLS Logstore. For more information, see Configure log collection.
FAQ
Can I deploy multiple models in a single resource group?
Yes. As long as the resource group has sufficient capacity, you can deploy multiple model services in it.
Can I use idle EAS dedicated resources for DLC distributed training?
No. Dedicated EAS resources can only be used for service deployment and aren't available for DLC.