Acceleration sources

Limits

• You can use acceleration sources only after you purchase the query acceleration feature.

• Network connectivity is required between the acceleration source and the offline computing engine.

• Acceleration sources are supported only for the following compute engines: MaxCompute, E-MapReduce 3.x, E-MapReduce 5.x, CDH 5.x, CDH 6.x, Cloudera Data Platform 7.x, Huawei FusionInsight 8.x, and YashanDB DP5.3.

• If a tenant uses the MaxCompute compute engine, the acceleration source must be deployed in a virtual private cloud (VPC).

Permissions

• Super administrators, system administrators, and custom global roles with the Acceleration Source Management - Create permission can create acceleration sources.

• Super administrators, system administrators, and custom global roles with the Acceleration Source Management - Edit permission can edit acceleration sources.

• Super administrators, system administrators, and custom global roles with the Acceleration Source Management - Delete permission can delete acceleration sources.

Create an acceleration source

1. In the top menu bar of the Dataphin home page, choose Planning > Acceleration Source.

2. On the Acceleration Sources page, click Create Acceleration Source.

3. On the Create Acceleration Source page, configure the following parameters.

   Parameter		Description
   Basic Information	Acceleration Source Name	Enter a name for the acceleration source. The name can contain any characters, be up to 128 characters long, and must be unique within the tenant.
   	Code	Enter a code. The code can contain only digits, letters, and underscores (_), be up to 64 characters long, and must be unique within the tenant.
   	Engine Type	Select StarRocks, Doris, or SelectDB.
   	Description (Optional)	Enter a brief description of the acceleration source. The description can contain any characters and be up to 1,000 characters long.
   Connection Configuration	JDBC URL	Enter the Java Database Connectivity (JDBC) connection address. For example, jdbc:mysql://host:port/dbname.
   	Username, Password	Enter the username and password for authentication.
   	Resource Group (Optional)	Select one or more resource groups obtained from the server.
   Acceleration Configuration	External Catalog Of Acceleration Source	On the acceleration source side, accelerated queries are performed through an external catalog. If an external catalog already exists, configure the mapping between the compute source and the catalog. If no external catalog exists, the system automatically creates one and maintains the mapping. MaxCompute compute engine If an external catalog for the acceleration source already exists: Click Add Mapping to add a new empty mapping row. Then, select a Compute Source and a Catalog. Compute Source: From the drop-down list, select the target compute source. The list contains all MaxCompute compute sources in the current tenant, excluding Hologres compute sources. Catalog: From the drop-down list, select the target catalog. The list contains all catalogs of the acceleration source. If no external catalog for the acceleration source exists: Select the compute sources to accelerate. Hive Metastore (HMS) must be enabled. If an SQL statement contains tables from a compute source that is not accelerated, the acceleration will fail. Compute Source: From the drop-down list, select one or more compute sources. The list contains all MaxCompute compute sources in the current tenant, excluding Hologres compute sources. MaxCompute Quota: The quota can contain any characters and be up to 128 characters long. The default value is pay-as-you-go. You can find the quota name in the MaxCompute console under Workspace > Configuration Management. Hadoop compute engine If an external catalog for the acceleration source already exists: Click Add Mapping to add a new empty mapping row. Then, select a Hadoop Cluster and a Catalog. Hadoop Cluster: From the drop-down list, select the target compute source. The list contains all Hadoop clusters in the current tenant. Catalog: From the drop-down list, select the target catalog. The list contains all catalogs of the acceleration source. If no external catalog for the acceleration source exists: Select the Hadoop clusters to accelerate. If an SQL statement contains tables from a cluster that is not accelerated, the acceleration will fail. If the Hadoop cluster uses Kerberos authentication, you must configure the authentication on the acceleration source side in advance. Otherwise, acceleration will not work correctly. For more information about how to configure Kerberos authentication, see Doris/SelectDB and StarRocks. Hadoop Cluster: From the drop-down list, select one or more Hadoop clusters. The list contains all Hadoop clusters in the current tenant.
   Creation Details		Note You can view the creation details only after you set External Catalog of Acceleration Source to Not created, complete the configuration, and click Create External Catalog. The creation details list shows the Compute Source Name (for MaxCompute compute engines) or Cluster Name (for Hadoop compute engines), Status, and Log. The status can be Pending Configuration, Configuring, Configuration Complete, or Configuration Failed. If the configuration is complete or has failed, click View Log in the Log column to view the creation log in the test log dialog box.

4. Click Save. The system saves the mapping.

   If you set External Catalog of Acceleration Source to an existing catalog, the system verifies whether the catalog matches the compute source.

Manage acceleration sources

1. In the top menu bar of the Dataphin home page, choose Planning > Acceleration Source.

2. On the Acceleration Sources page, view the list of acceleration sources. The list displays the name, description, engine type, and creation information for each source.

3. (Optional) In the search box, enter a keyword from an acceleration source's name to perform a fuzzy search. You can also filter the sources by engine type.

4. In the Actions column for the target acceleration source, perform management operations.

   Operation	Description
   Edit	Click the icon in the Actions column of the target acceleration source to open the Edit Acceleration Source page. Edit the configuration items according to the descriptions for the create operation, and then click Save.
   Delete	Single delete: Click the icon in the Actions column of the target acceleration source to delete the current acceleration source. Delete multiple sources: Select multiple acceleration sources, or select all sources. Then, click Delete at the bottom of the list to delete all selected sources. Note You can delete an acceleration source even if it is being referenced.