Perform batch operations on data migration tasks
This topic describes how to perform batch operations on data migration tasks using Data Transmission Service.
Background information
Data Transmission Service supports batch operations on data migration tasks on the Migration Task List page. The supported batch operations vary based on the status of the data migration task.
Status of the data migration task | Supported batch operations |
Not configured | None |
Not started | Batch start, Batch edit alert rule |
Running | The supported batch operations for running tasks vary by scenario.
|
Modifying | Batch edit alert rule |
Merging | Batch edit alert rule |
Paused | Batch resume, Batch end, Batch edit alert rule, Batch skip full verification (if the task has entered the full verification stage). |
Failed | Batch resume, Batch end, Batch edit alert rule, Batch skip full verification (if the task has entered the full verification stage). |
Completed | Batch end |
Ending | None |
Ended | None |
If you select multiple tasks for a batch operation and some tasks do not meet the criteria for that operation, a dialog box appears. The dialog box lists the tasks that are eligible for the operation.
Go to the Migration Task List page
Log on to the OceanBase Management Console .
In the navigation pane on the left, click Data Transmission Service > Data Migration to go to the Migration Task List page.
On this page, you can select the data migration tasks for batch operations and perform the relevant actions.
Batch pause
Data Transmission Service supports the Batch Pause operation for data migration tasks that are in the Running state.
On the Migration Task List page, select the data migration tasks that you want to pause.
At the bottom of the page, click Batch Pause.
In the dialog box that appears, click OK.
The dialog box shows the number of tasks that can be paused, the task names, and the latest offsets.
After the tasks are paused, a message appears that indicates the number of successful operations.
If an operation fails, troubleshoot the issue based on the page prompts.
Batch resume
Data Transmission Service supports the Batch Resume operation for data migration tasks that are in the Paused or Failed state.
On the Migration Task List page, select the data migration tasks that you want to resume.
At the bottom of the page, click Batch Resume.
In the dialog box that appears, click OK.
The dialog box shows the number of tasks that can be resumed, the task names, and the latest offsets.
After the tasks are resumed, a message appears that indicates the number of successful operations.
If an operation fails, troubleshoot the issue based on the page prompts.
Batch end
Data Transmission Service supports the Batch End operation on data migration tasks that are in the Paused, Failed, or Complete state.
On the Migration Task List page, select the data migration tasks to end.
At the bottom of the page, click Batch End.
In the dialog box that appears, click OK.
The dialog box shows the number of tasks that can be ended, the task names, and the latest offsets.
After the tasks are ended, a message appears that indicates the number of successful operations.
If an operation fails, troubleshoot the issue based on the page prompts.
Batch forward switchover
Data Transmission Service supports the Batch Forward Switchover operation for data migration tasks that are in the Running state and at the same checkpoint step of a forward switchover (excluding the switchover precheck step).
Being at the same checkpoint step of the forward switchover means that the selected tasks are at the same child step of the switchover. The child steps of a forward switchover include starting the forward switchover, performing a switchover precheck, starting the destination store, confirming that writes to the source have stopped, confirming that synchronization has caught up to the write-stop offset, stopping forward synchronization, processing database objects, and starting reverse incremental migration.
The child steps of a forward switchover vary based on the migration type that was selected when the task was created.
On the Migration Task List page, select the data migration tasks for batch forward switchover.
At the bottom of the page, click Batch Forward Switchover.
In the dialog box that appears, click OK.
The dialog box shows the number of tasks eligible for batch forward switchover, the task names, and the latest offsets.
In the Batch Forward Switchover dialog box, perform the operations in sequence as prompted.
Start forward switchover
In the upper-right corner of the Start Forward Switchover section, click Confirm Start to start the forward switchover for all tasks. You can also click Start next to a task to start it individually.
Switchover precheck
This step checks whether the current task status meets the switchover conditions. If the precheck passes, the next step runs automatically. If the precheck fails, error details are displayed.
If the precheck fails, you can click Retry or Skip. If you click Skip, you must click Skip again in the dialog box that appears.
Start destination store
This step starts incremental data pulling at the destination and starts the destination store. If the startup fails, you can click Retry or Skip.
Confirm source write stop
In the upper-right corner of the Confirm Source Write Stop section, click Confirm to run this child step for all tasks. You can also click Confirm next to each task to run it individually.
Confirm synchronization catches up to the write-stop offset
Data Transmission Service automatically checks whether the source and destination are at the same offset. After the check is complete, the current incremental synchronization latency and offset are displayed. If the synchronization fails to catch up to the write-stop offset, you can click Retry or Skip.
Stop forward synchronization
This step stops incremental synchronization from the source to the destination. If the operation fails, you can click Retry or Skip.
Process database objects
In the upper-right corner of the Process Database Objects section, click Mark as Completed to process the database objects for all tasks. You can also click Mark as Completed next to each task to run it individually. Proceed to the next step after all tasks are marked as completed.
Start a reverse incremental backup
In the upper-right corner of the Start Reverse Incremental Migration section, click Confirm Start to start incremental writing from the destination to the source for all tasks. You can also click Start next to each task to start it individually. Wait for the Reverse incremental migration started successfully message to appear.
Batch start
Data Transmission Service supports the Batch Start operation on data migration tasks that are in the Not Started state.
On the Migration Task List page, select the data migration tasks to start.
At the bottom of the page, click More Batch Operations > Batch Start.
In the dialog box that appears, click OK.
The dialog box shows the number of tasks that can be started, the task names, and the latest offsets.
After the tasks are started, a message appears that indicates the number of successful operations.
If an operation fails, troubleshoot the issue based on the page prompts.
Batch enter forward switchover
Data Transmission Service supports Batch Enter Forward Switchover for data migration tasks that are in the Running state and have completed Full Data Verification.
On the Migration Task List page, select the data migration tasks to enter forward switchover.
At the bottom of the page, click More Batch Operations > Batch Enter Forward Switchover.
In the dialog box that appears, click OK.
The dialog box shows the number of tasks that can enter forward switchover, the task names, and the latest offsets.
After the tasks successfully enter forward switchover, a message appears that indicates the number of successful operations.
If an operation fails, troubleshoot the issue based on the page prompts.
Batch edit alert rule
Data Transmission Service supports the Batch Edit Alert Rule operation for data migration tasks in the Not Started, Running, Being Modified, Merging, Paused, or Failed state.
On the Migration Task List page, select the data migration tasks for which to edit alert rules.
At the bottom of the page, click More Batch Operations > Batch Edit Alert Rule.
In the Batch Configure Alerting dialog box, configure the parameters.
On the Migration Task List page, you can check whether an alert rule is set for a target task. If no alert rule is set, you can enable Task status monitoring or Incremental latency monitoring as needed. If an alert rule is already set for a target task, you can modify it.
ImportantEditing alert rules in batch overwrites the existing monitoring and alerting settings for the selected tasks. Proceed with caution.
Category
Parameter
Description
Enable task status monitoring
Alert rule
The task status is abnormal.
This includes all exceptions that occur during the startup and running of precheck, schema migration, full migration, and incremental migration or incremental synchronization tasks.
Alert frequency
The interval at which an alert is sent. The value must be between 60 seconds and 604,800 seconds (7 days).
Alerting method
Data Transmission Service supports three alerting methods: DingTalk, Lark, and Alibaba Cloud CMS external alert address.
Alert address
After selecting an alerting method, enter the alert address of the corresponding chatbot. For more information, see Configure alert addresses.
Remarks (Optional)
The remarks for the alert address.
Enable incremental latency monitoring
Incremental latency
The alert threshold for incremental latency.
If the incremental synchronization latency in a data migration task exceeds the specified threshold, an alert is triggered.
Alert frequency
The interval at which an alert is sent. The value must be between 60 seconds and 604,800 seconds (7 days).
Alerting method
Data Transmission Service supports three alerting methods: DingTalk, Lark, and Alibaba Cloud CMS external alert address.
Alert address
After selecting an alerting method, enter the alert address of the corresponding chatbot. For more information, see Configure alert addresses.
Remarks (Optional)
The remarks for the alert address.
Click Submit.
You can also click Submit and Test to test whether the alert monitoring message is sent successfully. The alert monitoring messages are sent to the recipients through the contact methods added on the Cloud Monitor platform.
To view alert monitoring messages for data migration or data synchronization tasks, see View task alert information.
After the alert rules are edited, a message appears. If an operation fails, troubleshoot the issue based on the page prompts.
Batch skip full verification
Data Transmission Service supports the Batch Skip Full Data Verification operation for data migration tasks that have entered the full data verification stage but have not yet succeeded, and are in the Running, Paused, or Failed state.
On the Migration Task List page, select the data migration tasks for which to skip full verification.
At the bottom of the page, click More Batch Operations > Batch Skip Full Verification.
In the dialog box that appears, click OK.
The dialog box shows the number of tasks for which full verification can be skipped, the task names, and the latest offsets.
After full verification is skipped for the tasks, a message appears that indicates the number of successful operations.
If an operation fails, troubleshoot the issue based on the page prompts.