Supported data sources-Dataphin(Dataphin)-阿里云帮助中心

Data integration supports offline integration, real-time integration, and full database migration. This topic lists the data sources supported by offline integration, real-time integration, and full database migration.

Use cases for different integration types

Integration type	Use cases
Offline integration	Used for cloud migration and for moving data from the cloud to on-premises systems. For example, you can migrate data from an on-premises MySQL database to ApsaraDB RDS.
Full database migration	Used to synchronize data from a self-managed database in an on-premises data center or on an ECS instance to an offline data warehouse (Hive) or to MaxCompute. For example, you can migrate data from a self-managed MySQL database on an ECS instance to MaxCompute.
Real-time integration	Used to continuously synchronize data changes from an entire source database to a target, keeping the source and target synchronized in real time.

Data sources for offline integration

Data source	Read	Write
Big data storage data sources
MaxCompute	Supported	Supported
Hive	Supported	Supported
Hologres	Supported	Supported
Impala	Supported	Supported
TDH Inceptor	Supported	Supported
Kudu	Supported	Supported
StarRocks	Supported	Supported
Hudi	Supported	Supported
Doris	Supported	Supported
GreenPlum	Supported	Supported
TDengine	Supported	Not supported
ArgoDB	Supported	Supported
SelectDB	Supported	Supported
Databricks	Supported	Supported
Amazon Redshift	Supported	Supported
DolphinDB	Supported	Supported
Snowflake	Supported	Supported
Data Lake Formation	Supported	Supported
File data sources
HDFS	Supported	Supported
FTP	Supported	Supported
Object Storage Service	Supported	Supported
Amazon S3	Supported	Supported
Message queue data sources
Log Service	Supported	Not supported
Kafka	Supported	Supported
DataHub	Supported	Supported
Relational data sources
PolarDB	Supported	Supported
PolarDB-X	Supported	Supported
MySQL	Supported	Supported
SAP HANA	Supported	Supported
Microsoft SQL Server	Supported	Supported
PostgreSQL	Supported	Supported
AnalyticDB for MySQL 2.0	Supported	Not supported
AnalyticDB for MySQL 3.0	Supported	Supported
AnalyticDB for PostgreSQL	Supported	Supported
OceanBase	Supported	Supported
Oracle	Supported	Supported
Vertica	Supported	Supported
IBM DB2	Supported	Supported
Teradata	Supported	Supported
ClickHouse	Supported	Supported
DM	Supported	Supported
GBase 8a	Supported	Supported
KingbaseES	Supported	Supported
TiDB	Supported	Supported
GoldenDB	Supported	Supported
OpenGauss	Supported	Supported
GaussDB (DWS)	Supported	Supported
Amazon RDS for PostgreSQL	Supported	Supported
Amazon RDS for MySQL	Supported	Supported
Amazon RDS for SQL Server	Supported	Supported
Amazon RDS for Oracle	Supported	Supported
Amazon RDS for DB2	Supported	Supported
TDSQL for MySQL	Supported	Supported
PolarDB-X 2.0	Supported	Supported
GBase 8c	Supported	Supported
TDSQL for PostgreSQL	Supported	Supported
OushuDB	Supported	Supported
NoSQL data sources
HBase 0.9.4	Not supported	Not supported
HBase 1.1.x	Supported	Supported
HBase 2.0	Supported	Supported
Elasticsearch	Supported	Supported
MongoDB	Supported	Supported
Tablestore	Supported	Supported
ApsaraDB for HBase	Not supported	Not supported
Redis	Not supported	Supported
Easysearch	Supported	Supported
OpenSearch	Supported	Supported
InfluxDB	Supported	Supported
Lindorm	Supported	Supported
Semi-structured data sources
API	Supported	Supported
SAP Table	Supported	Not supported
Salesforce	Supported	Not supported
Lark Base	Supported	Supported

Data sources for full database migration

Data source type

Data source

Related documentation

Source data source

MySQL, Oracle, Microsoft SQL Server, OceanBase, IBM DB2, MaxCompute, FTP, TDengine, Hive, PostgreSQL, Dameng (DM), Amazon Redshift, Amazon RDS for PostgreSQL, Amazon RDS for MySQL, Amazon RDS for SQL Server, Amazon RDS for Oracle, Amazon RDS for DB2, TDSQL for MySQL, DolphinDB, PolarDB-X 2.0, GBase 8c.

Destination data source

ArgoDB, TDH Inceptor, OushuDB, Hive, MaxCompute, AnalyticDB for PostgreSQL, StarRocks, SelectDB, Doris, GaussDB (DWS), Lindorm, Databricks, Data Lake Formation.

Supported data sources for real-time integration

Real-time compute engine		Data source	Related documents
Apache Flink	Flink on YARN	Sources: MySQL, Microsoft SQL Server, PostgreSQL, Oracle, IBM DB2, Kafka, Hive (Hudi table format), and PolarDB (MySQL database type) Sinks: MaxCompute (standard tables and delta tables), MySQL, Oracle, Kafka, DataHub, Databricks, Microsoft SQL Server, SelectDB, Hive (Hive, Hudi, Iceberg, and Paimon table formats), Hologres, StarRocks, and OushuDB	Create a MySQL data source Create an Oracle data source Create a PostgreSQL data source Create a Microsoft SQL Server data source Create an IBM DB2 data source Create a Kafka data source Create a MaxCompute data source Create a Hive data source Create a DataHub data source Create a Databricks data source Create a SelectDB data source Create a PolarDB data source Create a Hologres data source Create a StarRocks data source Create an OushuDB data source Create a Data Lake Formation data source
	Flink on K8s	Sources: MySQL, Microsoft SQL Server, PostgreSQL, Oracle, Kafka, and PolarDB (MySQL database type) Sinks: MySQL, Oracle, Kafka, Databricks, Microsoft SQL Server, SelectDB, Hologres, StarRocks, and OushuDB
Realtime Compute for Apache Flink		Sources: MySQL, Microsoft SQL Server, PostgreSQL, Oracle, IBM DB2, Kafka, and PolarDB (MySQL database type) Sinks: MaxCompute (standard tables and delta tables), MySQL, Oracle, Kafka, DataHub, Databricks, Microsoft SQL Server, SelectDB, Hologres, OushuDB, and Data Lake Formation