Supported data sources for data integration
Data Integration supports offline integration, real-time integration, and full-database migration. This topic describes the data source types supported by offline integration, real-time integration, and full-database migration.
Use cases for different integration types
Integration type | Scenarios |
Offline integration | Suitable for scenarios such as migrating data to the cloud or moving data from the cloud to on-premises systems. For example, you can migrate data from an on-premises MySQL database to an Alibaba Cloud RDS database. |
Full-database migration | Suitable for synchronizing data from on-premises data centers or self-managed databases on ECS instances to offline data warehouses like Hive or to services like MaxCompute. For example, you can migrate data from a self-managed MySQL database on an ECS instance to MaxCompute. |
Real-time integration | Suitable for real-time integration of data changes from an entire database or all tables in a source data source to a destination data source, keeping the source and destination data sources synchronized. |
Data sources supported for offline integration
Data source | Read | Write |
Big data storage data sources | ||
MaxCompute | Supported | Supported |
Hive | Supported | Supported |
Hologres | Supported | Supported |
Impala | Supported | Supported |
TDH Inceptor | Supported | Supported |
Kudu | Supported | Supported |
StarRocks | Supported | Supported |
Hudi | Supported | Supported |
Doris | Supported | Supported |
Greenplum | Supported | Supported |
TDengine | Supported | Not supported |
ArgoDB | Supported | Supported |
SelectDB | Supported | Supported |
Databricks | Supported | Supported |
Amazon Redshift | Supported | Supported |
DolphinDB | Supported | Supported |
Snowflake | Supported | Supported |
Data Lake Formation | Supported | Supported |
File data sources | ||
HDFS | Supported | Supported |
FTP | Supported | Supported |
OSS | Supported | Supported |
Amazon S3 | Supported | Supported |
Message queue data sources | ||
Log Service | Supported | Not supported |
Kafka | Supported | Supported |
DataHub | Supported | Supported |
Relational data sources | ||
PolarDB | Supported | Supported |
PolarDB-X (formerly DRDS) | Supported | Supported |
MySQL | Supported | Supported |
SAP HANA | Supported | Supported |
Microsoft SQL Server | Supported | Supported |
PostgreSQL | Supported | Supported |
AnalyticDB for MySQL 2.0 | Supported | Not supported |
AnalyticDB for MySQL 3.0 | Supported | Supported |
AnalyticDB for PostgreSQL | Supported | Supported |
OceanBase | Supported | Supported |
Oracle | Supported | Supported |
Vertica | Supported | Supported |
IBM DB2 | Supported | Supported |
Teradata | Supported | Supported |
ClickHouse | Supported | Supported |
DM (Dameng) | Supported | Supported |
GBase 8a | Supported | Supported |
KingbaseES | Supported | Supported |
TiDB | Supported | Supported |
GoldenDB | Supported | Supported |
OpenGauss | Supported | Supported |
GaussDB (DWS) | Supported | Supported |
Amazon RDS for PostgreSQL | Supported | Supported |
Amazon RDS for MySQL | Supported | Supported |
Amazon RDS for SQL Server | Supported | Supported |
Amazon RDS for Oracle | Supported | Supported |
Amazon RDS for DB2 | Supported | Supported |
TDSQL for MySQL | Supported | Supported |
PolarDB-X 2.0 | Supported | Supported |
GBase 8c | Supported | Supported |
TDSQL for PostgreSQL | Supported | Supported |
OushuDB | Supported | Supported |
NoSQL data sources | ||
HBase 0.9.4 | Not supported | Not supported |
HBase 1.1.x | Supported | Supported |
HBase 2.0 | Supported | Supported |
Elasticsearch | Supported | Supported |
MongoDB | Supported | Supported |
Table Store | Supported | Supported |
ApsaraDB for HBase | Not supported | Not supported |
Redis | Supported | Not supported |
Easysearch | Supported | Supported |
OpenSearch | Supported | Supported |
InfluxDB | Supported | Supported |
Lindorm | Supported | Supported |
Semi-structured data sources | ||
API | Supported | Supported |
SAP Table | Supported | Not supported |
Salesforce | Supported | Not supported |
Lark Base | Supported | Supported |
Data sources supported for full-database migration
Data source type | Data source | Related documentation |
Source data source | MySQL, Oracle, Microsoft SQL Server, OceanBase, IBM DB2, MaxCompute, FTP, TDengine, Hive, PostgreSQL, DM (Dameng), Amazon Redshift, Amazon RDS for PostgreSQL, Amazon RDS for MySQL, Amazon RDS for SQL Server, Amazon RDS for Oracle, Amazon RDS for DB2, TDSQL for MySQL, DolphinDB, PolarDB-X 2.0, and GBase 8c. | |
Destination data source | ArgoDB, TDH Inceptor, OushuDB, Hive, MaxCompute, AnalyticDB for PostgreSQL, StarRocks, SelectDB, Doris, GaussDB (DWS), Lindorm, Databricks, and Data Lake Formation. |
Data sources supported for real-time integration
Real-time compute engine | Data source | Related documentation | |
Apache Flink (open source) | Flink on YARN |
| |
Flink on K8s |
| ||
Realtime Compute for Apache Flink (VVP) |
| ||