Create a Lindorm data source

Permissions

Only custom global roles with the new data source permission and the system roles Super Administrator, Data Source Administrator, Plate Architect, and Project Administrator can create data sources.

Procedure

1. On the Dataphin homepage, click management center > data source management in the top navigation bar.

2. On the data source page, click + new data source.

3. On the new data source page, in the NoSQL section, select Lindorm.

   If you have recently used Lindorm, you can select it from the Recently Used section or enter Lindorm keywords in the search box to find it.

4. On the new Lindorm data source page, configure the connection parameters for the data source.

   1. Configure basic information for the data source

      Parameter	Description
      data source name	Enter a name for the data source. The name must meet the following requirements: Can contain only Chinese characters, letters, numbers, underscores (_), and hyphens (-). Cannot exceed 64 characters in length.
      data source code	After you configure the data source code, you can directly access Dataphin data source tables in Flink_SQL tasks or through the Dataphin JDBC client by using the format data_source_code.table_name or data_source_code.schema.table_name. To automatically switch data sources based on the task execution environment, use the variable format ${data_source_code}.table or ${data_source_code}.schema.table. For more information, see Develop Dataphin data source tables. Important The data source code cannot be modified after it is configured. You can preview data on the object details page in the asset directory and asset checklist only after the data source code is configured. In Flink SQL, only MySQL, Hologres, MaxCompute, Oracle, StarRocks, Hive, SelectDB, and GaussDB data warehouse service (DWS) data sources are currently supported.
      data source description	Enter a brief description of the data source. The description cannot exceed 128 characters.
      Data source configuration	Select the data source to configure: If your business data source distinguishes between production and development data sources, select Production + Development Data Source. If your business data source does not distinguish between production and development data sources, select Production Data Source.
      tag	You can use tags to categorize data sources. To create tags, see Manage data source tags.

   2. Configure connection parameters between the data source and Dataphin

      If you select Production + Development Data Source, you must configure the connection information for the Production + Development Data Source. If your data source is configured as a Production Data Source, you only need to configure the connection information for the Production Data Source. Different Connection Types require different parameters, as detailed in the following table.

      Note

      Typically, you should configure the production and development data sources as separate instances to isolate environments and reduce the risk of development activities affecting the production environment. However, Dataphin also allows you to configure them as the same data source by using identical parameter values.

      Spark ETL

      Parameter	Description
      core-site.xml	Upload the Lindorm configuration files: core-site.xml, hdfs-site.xml, and hive-site.xml.
      hdfs-site.xml
      hive-site.xml
      JDBC URL	Enter the JDBC URL for Lindorm. The format is jdbc:hive2://host:port/;?token=xxx.
      username and password	The username and password for accessing the Lindorm instance.

      MySQL engines

      Parameter	Description
      JDBC URL	Enter the JDBC URL for Lindorm, for example, jdbc:mysql://host:port.
      username and password	The username and password for accessing the Lindorm instance.

      HBase wide table

      Parameter	Description
      endpoint	The endpoint used to connect to Lindorm. To obtain the connection address, see Cloud-native multi-model database Lindorm (Wide Table) - Connect to and use an instance.
      namespace	The namespace for the Lindorm instance. The default value is default.
      username and password	The username and password for accessing the Lindorm instance.
      connection parameters (optional)	Additional connection parameters for Lindorm. Use JSON format.

5. Select the default resource group, which runs tasks related to the current data source, such as database SQL, offline full database migration, and data preview.

6. Click test connection to verify the connection, or click OK to save the configuration and create the Lindorm data source.

   When you click test connection, the system verifies that Dataphin can connect to the data source. If you click OK directly, the system automatically tests the connection for all selected clusters. However, Dataphin creates the data source even if connection tests fail.