If you run a large number of Data Transmission Service (DTS) tasks at a time, the usage of resources, such as CPU and memory, may increase rapidly. This affects your business. You can create DTS dedicated clusters and then configure data migration, data synchronization, and change tracking tasks in the clusters. This way, resources are isolated for the tasks and the stability of the tasks is improved.
Prerequisites
If you use a RAM user to create a DTS dedicated cluster, the parent Alibaba Cloud account must have the AliyunDTSDefaultRole role and then grant the AliyunDTSFullAccess permission to the RAM user.
For details about how to grant the AliyunDTSDefaultRole role and the AliyunDTSFullAccess permission, see Authorize DTS to access cloud resources and Use a system policy to authorize a RAM user to manage DTS.
Benefits
You can create only data migration, data synchronization, and change tracking tasks in DTS dedicated clusters. DTS dedicated clusters have the following benefits:
-
DTS dedicated clusters provide independent resources that are isolated from the resources used by DTS instances of other users. The DTS instances created in your DTS dedicated clusters can never be affected by the DTS instances of other users. In addition, you can control the loads of your DTS dedicated clusters to enhance the stability of your business.
-
In a DTS dedicated cluster, you can allocate the resources of the entire cluster to a single DTS instance to improve the performance of the DTS instance. This allows you to write large amounts of data to the source database and synchronize the data to the destination database in real time.
-
You are charged only for the resources of DTS dedicated clusters. You do not need to pay fees when you create DTS instances in the clusters. The cost is further reduced if you enable the overcommitment mode for a DTS dedicated cluster, compared with the cost of purchasing a large number of DTS instances.
Limits
-
DTS dedicated clusters support only the subscription billing method. You must pay when you create a DTS dedicated cluster.
-
You are charged only for the resources of DTS dedicated clusters. You do not need to pay fees when you create DTS instances in the clusters.
-
DTS dedicated clusters can be created only in the following regions: China (Hangzhou), China (Shanghai), China (Beijing), China (Zhangjiakou), China (Hohhot), China (Ulanqab), China (Shenzhen), China (Guangzhou), China (Chengdu), China (Hong Kong), Singapore, Japan (Tokyo), US (Virginia), and Germany (Frankfurt).
-
If you want to configure a data synchronization task in a DTS dedicated cluster, the source database, destination database, and DTS dedicated cluster must reside in the same region.
-
The number of nodes and the size of disks in a DTS dedicated cluster cannot be reduced.
-
You can create up to five DTS dedicated clusters in a single region. If you need to create more than five DTS dedicated clusters in a region, contact Alibaba Cloud technical support to add your account to the whitelist for creating more DTS dedicated clusters.
NoteWe recommend that you create two or more DTS dedicated clusters to implement disaster recovery. Make sure that the available resources, such as the CPU, memory, disks, and DTS units (DUs), in a cluster are greater than 1/N. Otherwise, switchovers may fail due to insufficient hardware resources. N is the number of nodes in a cluster. For example, if you have three nodes in a cluster, the available resources must be greater than one-third of the total resources of the cluster.
-
If the usage of resources in a DTS dedicated cluster, such as CPU, memory, and disks, exceeds 80%, you must scale up the cluster at the earliest opportunity. The task failures or switchover failures caused by insufficient resources are not covered by the Service Level Agreement of DTS.
-
After a DTS dedicated cluster is created, the system reserves 5% of the disk space for defragmentation and to ensure that the system runs properly even if the disk is full.
Billing
For more information about the billing of DTS dedicated clusters, see Billing of DTS dedicated clusters.
Procedure
-
Go to the DTSDTS Dedicated Clusters page.
-
To the right of Workbench, select the region where you want to create the dedicated cluster.
NoteIf you are logged in to the Data Management (DMS) console, select the region for the dedicated cluster to the right of Cluster Task.
-
Below Cluster Task, click Create Dedicated Cluster.
-
Configure the following parameters based on your business requirements:
Parameter
Description
Product type
Select Data Transmission Service DTS (Subscription).
Cluster type for DTS instances
Select Dedicated Cluster.
Dedicated cluster region
Select the region where the dedicated cluster will be located.
NoteThe region of a dedicated cluster cannot be changed after the cluster is created.
Dedicated cluster type
This parameter is fixed to Data Migration, Data Synchronization, and change tracking.
Dedicated cluster node specification
This parameter is fixed to 15 DU (DTS Unit).
Note-
Currently, only the 15 DU node specification is available for purchase. One DTS Unit (DU) represents the minimum hardware resources required to run one DTS task. A 15 DU node can run up to 15 DTS tasks without overcommitment, with hardware resources isolated for each task. You can also allocate the resources of multiple DUs to a single task.
-
If you enable overcommitment (for example, by setting the ratio to 200%), the displayed node specification increases to 30 DU, while the actual hardware resources remain at 15 DU. This allows you to configure up to 30 DTS tasks on the node. However, with overcommitment enabled, DTS tasks compete for hardware resources, and each task might receive only 50% of the hardware resources that would be available without overcommitment. Overcommitment is suitable only for the following scenarios:
-
The volume of incremental data for synchronization is small.
-
The workloads of different DTS synchronization tasks have staggered, off-peak schedules.
-
-
For a comparison between dedicated cluster and public cluster specifications, see Migrate a DTS instance between a dedicated cluster and a public cluster.
Dedicated cluster node storage
Select the storage space for each node in the cluster. Valid values: 1,024 GB to 30,720 GB. The value must be in increments of 512 GB.
NoteAfter the cluster is created, you can increase the storage space by scaling up the node disk space. For more information, see Scale up the disk space of a dedicated cluster.
Destination instance region
By default, this parameter is set to the same value as Dedicated cluster region and cannot be changed.
Resource Group
You do not need to configure this parameter in this example. For more information, see What is Resource Management?.
Number of nodes
Select the number of nodes for the cluster. Default value: 2. Valid values: 2 to 100.
Note-
To enable disaster recovery for cluster nodes, you must purchase at least two nodes.
-
After the cluster is created, you can increase the number of nodes by scaling out the cluster. For more information, see Scale out a DTS dedicated cluster.
Subscription duration
Select the subscription duration. You can select 1 to 9 months, or 1, 2, 3, or 5 years.
ImportantIf you want the cluster to be automatically renewed upon expiration, select Auto-renewal and ensure that your account has a sufficient balance before the expiration date.
-
-
Purchase the DTS dedicated cluster.
-
Click Buy Now.
-
On the Confirm Order page, review the configuration details, and then read and select the terms of service.
-
Click Pay, and then follow the on-screen instructions on the Pay page to complete the payment.
NoteYou can also click Add to Cart to pay for the cluster along with other products. For instructions, see Checkout from the cart.
-
-
Check whether the DTS dedicated cluster is created.
-
After the payment is complete, click Console to go to the DTS console.
-
In the left-side navigation pane, click Dedicated Cluster.
-
In the top navigation bar, select the region in which the DTS dedicated cluster resides.
-
Check whether the DTS dedicated cluster that you just created is in the cluster list.
-
If the cluster appears, it has been created. The cluster is created successfully when its status changes to Running.
-
If the DTS dedicated cluster is not displayed, wait for 1 to 5 minutes and then refresh the page. If the DTS dedicated cluster is still not displayed, check whether the issues that are described in the following table occur. If none of the issues occur, contact Alibaba Cloud technical support.
The following table describes the possible causes and solutions if you cannot find a DTS dedicated cluster in the cluster list.
Possible cause
Solution
The DTS dedicated cluster does not belong to the region that you select.
In the top navigation bar, select the region in which the DTS dedicated cluster resides.
The DTS dedicated cluster fails to be created due to insufficient resources.
A DTS dedicated cluster may fail to be created due to insufficient resources. In this case, the fees that you paid for the DTS dedicated cluster are refunded. Go to the Expenses and Costs console. In the left-side navigation pane, choose Cost Management > Orders. On the Orders page, you can check whether you receive the refund.
-
-
Pay for services in the cart
To check out with multiple items, click Add to Cart after configuring your subscription cluster. Then, follow these steps:
-
Click the Cart icon on the right side of the page.
-
In the cart panel, select the products that you want to purchase and click Proceed to Checkout.
-
On the Cart page, confirm that the correct products are selected.
-
If the selection is correct, click Buy Now.
-
If the selection is incorrect, select the correct products and click Buy Now.
-
-
On the Confirm Order page, read and select the terms of service, and then click Pay.
-
On the Pay page, follow the on-screen instructions to complete the payment.