Create an Aliyun EMR Serverless Spark compute source

Updated at:

Prerequisites

Procedure

  1. In the top navigation bar of Dataphin, choose Planning > Compute Source.

  2. On the Compute Source page, click New Compute Source and select Aliyun EMR Serverless Spark Compute Source.

  3. On the New Aliyun EMR Serverless Spark Compute Source page, configure the following parameters.

    Parameter

    Description

    Basic information

    Compute source type

    Select Aliyun EMR Serverless Spark.

    Compute source name

    Up to 64 characters. Supports Chinese characters, letters, digits, underscores (_), and hyphens (-).

    Configuration method

    Only Reference Specified Cluster is supported. Search for a cluster by keyword. After selecting one, click View to check its details on the View Aliyun EMR Serverless Spark Cluster page.

    Compute source description (Optional)

    Up to 128 characters.

    Connection configuration

    Workspace

    Inherited from the selected cluster. Cannot be modified.

    Catalog

    Select a catalog. The dropdown lists all catalogs in the selected cluster.

    Schema

    Select a schema. The dropdown lists all schemas in the selected catalog.

    Gateway configuration

    Default gateway for production jobs

    The dropdown lists all gateways in the selected cluster, showing status, specifications, Spark version, Kyuubi Service Engine version, queue name, access method, and HA replica count for each.

    Gateway for other jobs

    Gateway for priority jobs

    Defaults to the production job gateway. If you select Custom, select a gateway for each priority level.

  4. Click Submit.

    After creation, you can bind the compute source to a project. .