Create an Aliyun EMR Serverless Spark compute source
Prerequisites
-
The Dataphin compute engine is set to Aliyun EMR Serverless Spark.
-
An Aliyun EMR Serverless Spark cluster is created. Create and manage an Aliyun EMR Serverless Spark cluster.
Procedure
-
In the top navigation bar of Dataphin, choose Planning > Compute Source.
-
On the Compute Source page, click New Compute Source and select Aliyun EMR Serverless Spark Compute Source.
-
On the New Aliyun EMR Serverless Spark Compute Source page, configure the following parameters.
Parameter
Description
Basic information
Compute source type
Select Aliyun EMR Serverless Spark.
Compute source name
Up to 64 characters. Supports Chinese characters, letters, digits, underscores (_), and hyphens (-).
Configuration method
Only Reference Specified Cluster is supported. Search for a cluster by keyword. After selecting one, click View to check its details on the View Aliyun EMR Serverless Spark Cluster page.
Compute source description (Optional)
Up to 128 characters.
Connection configuration
Workspace
Inherited from the selected cluster. Cannot be modified.
Catalog
Select a catalog. The dropdown lists all catalogs in the selected cluster.
Schema
Select a schema. The dropdown lists all schemas in the selected catalog.
Gateway configuration
Default gateway for production jobs
The dropdown lists all gateways in the selected cluster, showing status, specifications, Spark version, Kyuubi Service Engine version, queue name, access method, and HA replica count for each.
Gateway for other jobs
Gateway for priority jobs
Defaults to the production job gateway. If you select Custom, select a gateway for each priority level.
-
Click Submit.
After creation, you can bind the compute source to a project. .