DocsICP FilingConsole
Documentation
Home Page Dataphin Dataphin(Non-shared) User Guide Data service API Development Appendix Data sources and compute engines supported by DataService Studio

Data sources and compute engines supported by DataService Studio

Updated at:
Copy as MD
Product
My Favorites

This topic describes the data sources that DataService Studio supports for creating service units or APIs, along with the compute engines supported by logical table APIs.

Legend

Y indicates that the feature supports the data source or compute engine. N indicates that the feature does not support the data source or compute engine.

Limits

Only APIs for directly connected data sources support create, update, and delete operations.

Data sources supported by DataService Studio

  • APIs for directly connected data sources support synchronous and asynchronous call modes. If a data source supports asynchronous calls, this is indicated.

  • The support for configuring row-level permissions, paged queries, and returning the total number of entries varies between service units and APIs for directly connected data sources. The details are as follows:

    • If 'Y' is specified for row-level permissions, paged query, or returning the total number of entries, it means that both APIs and service units support the feature. If a feature is supported by only APIs or only service units, this is indicated.

    • If 'N' is specified for row-level permissions, paged query, or returning the total number of entries, it means that neither APIs nor service units support the feature.

  • For synchronous calls, an API can return a maximum of 10,000 query results. For both synchronous and asynchronous calls, the total number of entries that can be queried is unlimited.

  • Logical table APIs support paged queries.

  • If a data source supports transactions, this is indicated.

Data source

Data source version

Service unit

API for directly connected data source

Row-level permissions

Supports paged query

Supports returning total number of entries

Supports create, update, and delete operations

Big data storage

MaxCompute

/

N

Y (Asynchronous call mode only)

N

N

Y

N

Hive (Hudi, Iceberg, Paimon)

  • CDH 5.x Hive 1.1.0

  • Alibaba Cloud EMR 3.x Hive 2.3.5

  • Alibaba Cloud EMR 5.x Hive 3.1.x

  • CDH 6.x Hive 2.1.1

  • FusionInsight 8.x Hive 3.1.0

  • CDP 7.x Hive 3.1.3

  • AsiaInfo DP 5.x Hive 3.1.0

N

Y (Asynchronous call mode only)

Y

N

Y

N

Hologres

/

Y

Y

Y

Y

Y

N

Impala

  • CDH 5: 2.11.0

  • CDH 6: 3.2.0

  • CDP 7.1.3: 3.4.0

  • EMR 3.x: 3.4.0

  • EMR 5.x: 3.4.0

  • EMR 5.x: 4.2.0

N

Y

N

Y

Y

N

TDH Inceptor

  • 6.2.x

  • 9.3.x

N

Y (Supports synchronous and asynchronous call modes)

N

Y

Y

N

Doris

/

Y

Y (Supports synchronous and asynchronous call modes)

N

Y

Y

N

SelectDB

V3.x

Y

Y (Supports synchronous and asynchronous call modes)

Y

Y

Y

N

TDengine

/

N

Y

N

Y

Y

N

StarRocks

/

N

Y (Supports synchronous and asynchronous call modes)

Y

Y

Y

N

Databricks

2.6.40

N

Y (Supports synchronous and asynchronous call modes)

N

Y

Y

N

Amazon Redshift

1.0.x

Y

Y (Supports synchronous and asynchronous call modes)

N

Y

Y

N

DolphinDB

v2.00.11.2

N

Y (Supports synchronous and asynchronous call modes)

N

Y

Y

N

Relational database

PolarDB-X 2.0

/

Y

Y (Supports synchronous and asynchronous call modes)

N

Y

Y

N

MySQL

  • MySQL 5.1.43

  • MySQL 5.6/5.7

  • MySQL 8

  • RDS for MySQL

Y

Y

Y

Y

Y

Y (Supports transactions)

SAP HANA

/

N

Y

N

N

N

N

Microsoft SQL Server

/

Y

Y

Y

Y

Y

Y (Supports transactions)

PostgreSQL

/

Y

Y

Y

Y

Y

Y (Supports transactions)

AnalyticDB for MySQL 2.0

/

Y

N

Y

Y (Service units only)

Y (Service units only)

N

AnalyticDB for MySQL 3.0

/

Y

Y (Supports synchronous and asynchronous call modes)

Y

Y

Y

N

AnalyticDB for PostgreSQL

/

Y

N

Y

Y (Service units only)

Y (Service units only)

N

OceanBase

/

Y

Y (Supports synchronous and asynchronous call modes)

N

Y

Y

N

Oracle

  • Oracle 11g

  • Oracle 12c

  • Oracle 18c

  • Oracle 19c

  • Oracle 21c

  • Oracle23c

Y

Y

Y

Y

Y

Y (Supports transactions)

ClickHouse

/

N

Y

Y

Y

Y

N

Dameng DM (only 3.13.12 and v3.14.4)

/

Y

Y

N

Y

Y

N

GBase 8c

/

Y

Y (Supports synchronous call and asynchronous invocation patterns)

N

Y

Y

N

GaussDB (DWS)

/

N

Y

Y

Y

Y

N

Amazon RDS for PostgreSQL

/

Y

Y

Y (Service units only)

Y

Y

N

Amazon RDS for MySQL

  • MySQL 5.6/5.7

  • MySQL 8

Y

Y

Y (Service units only)

Y

Y

N

Amazon RDS for SQL Server

/

Y

Y

Y(Service units only)

Y

Y

N

Amazon RDS for Oracle

  • Oracle19c

  • Oracle21c

Y

Y

Y (Service units only)

Y

Y

N

GBase 8a

/

Y

Y(Supports synchronous call patterns and asynchronous invocation patterns)

N

Y

Y

N

TDSQL for MySQL

/

Y

Y(Supports synchronous call pattern and asynchronous invocation pattern)

Y

Y

Y

N

TDSQL for PostgreSQL

/

Y

Y (Supports synchronous calls and asynchronous invocations)

Y

Y

Y

N

NoSQL

Elasticsearch

  • Elasticsearch 6.x

  • Elasticsearch 7.x

  • Elasticsearch 8.x

Y

Y

N

Y(Service units only)

Y(Service units only)

N

HBase

  • HBase 0.94

  • HBase 1.1.x

  • HBase 2.x

Y

Y

N

N

N

N

MongoDB

  • MongoDB 3.2

  • MongoDB 3.4+

Y

N

N

Y (Service units only)

Y(Service units only)

N

Lindorm (wide table)

/

N

Y

N

Y

Y

N

OpenSearch

2.x

N

Y

N

Y

Y

N

Compute engines supported by logical table APIs

Compute engine

Logical table API

MaxCompute

Y

CDH 5.x, CDH 6.x

Y

Cloudera Data Platform 7.x

Y

AsiaInfo DP 5.3

Y

AnalyticDB for PostgreSQL

Y

Previous：Operators Supported by API DevelopmentNext：API SQL script editing