Supported DML and DDL operations
Updated at:
In real-time data synchronization, support for source DDL and DML operations varies based on the destination data source. This topic describes the supported source DDL and DML operations for different destination data sources.
Background information
- When you configure a sync task, you can select a feature module based on your source and destination data sources and the data sources that each DataWorks module supports. For more information, see Supported data sources and synchronization solutions.
- You can also select the data integration module to configure the sync task based on the number of source databases and tables to be synchronized and the number of tables to be written to the destination. For more information, see Supported number of databases or tables for synchronization.
Precautions
If a new column is added to the source and the operation is successfully executed on the destination, the following limitations apply:
- If you add a column that has a DEFAULT VALUE, the new column in the destination table is created with a NULL value. When new data is added to this column in the source, the real-time sync task synchronizes the new data to the destination column.
- If you add a VIRTUAL column, the new column in the destination table is created with a NULL value. When new data is added to this column in the source, the real-time sync task synchronizes the new data to the destination column.
For real-time synchronization from MySQL and PolarDB for MySQL sources, add new columns to the end of the source table. Do not add columns between existing fields. If you must add a column between existing fields in the source table, the following constraints apply:
- In an initial full and incremental synchronization solution, do not add columns between existing fields during the full synchronization phase. Otherwise, data anomalies occur during the real-time synchronization phase.
- During the real-time synchronization phase, you must set the synchronization offset reset time to a point after the DDL event that added the column. Otherwise, subsequent real-time synchronization results in data anomalies.
DML and DDL support
The following table describes the support for DML and DDL operations on the destination in real-time synchronization scenarios.
Note Real-time synchronization scenarios include real-time synchronization tasks in the Data Integration module and initial full and incremental synchronization tasks in the Synchronization Solution module. To configure and implement these tasks, go to the Real-time Synchronization and Synchronization Solution modules.
| Data source | DML | DDL - Table commands | DDL - Column commands | ||||||||
| Insert | Update | Delete | Create table | Drop table | Rename table | Truncate table | Add column | Drop column | Rename column | Modify column type | |
| AnalyticDB for MySQL 3.0 | Supported | Supported | Supported | - | - | - | Supported | Supported | - | - | - |
| DataHub | Supported | - | - | - | - | - | - | - | - | - | - |
| DRDS (PolarDB) | Supported | Supported | Supported | - | - | - | - | - | - | - | - |
| Elasticsearch | Supported | Supported | Supported | - | - | - | - | Supported | - | - | - |
| Hologres | Supported | Supported | Supported | - | - | - | Supported | Supported | - | - | - |
| Kafka | Supported | - | - | - | - | - | - | - | - | - | - |
| MaxCompute | Supported | - | - | - | - | - | Supported | Supported | - | - | - |
| MySQL | Supported | Supported | Supported | - | - | - | - | - | - | - | - |
| OSS | Supported | - | - | - | - | - | - | - | - | - | - |
| Oracle | Supported | Supported | Supported | - | - | - | - | - | - | - | - |
Is this page helpful?