Create a Milvus data source

Permissions

Only custom global roles with the Create Data Source permission and the following system roles can create data sources: Super Admin, Data Source Administrator, Domain Architect, and Project Administrator.

Procedure

1. On the Dataphin homepage, click Management Center > Data Source Management in the top navigation bar.

2. On the Data Source page, click + New Data Source.

3. On the New Data Source page, find and select Milvus in the Vector Database section.

   If you have used Milvus recently, you can also select it from the Recently Used section. Alternatively, you can enter "Milvus" in the search bar to find it quickly.

4. On the New Milvus Data Source page, configure the connection parameters.

   1. Configure the basic information for the data source.

      Parameter	Description
      Data Source Name	The name must meet the following requirements: Can contain only Chinese characters, letters, digits, underscores (_), and hyphens (-). Must not exceed 64 characters.
      Data Source Code	A unique identifier for the data source. After you configure the Data Source Code, you can reference a physical table from this data source in a Flink SQL job by using the format Data Source Code.table or Data Source Code.schema.table. To automatically access the data source for the current environment, use the format ${Data Source Code}.table or ${Data Source Code}.schema.table. Important The data source code cannot be modified after it is configured. You can preview data on the object details page in the asset directory and asset checklist only after the data source code is configured. In Flink SQL, only MySQL, Hologres, MaxCompute, Oracle, StarRocks, Hive, SelectDB, and GaussDB data warehouse service (DWS) data sources are currently supported.
      Version	Currently, only v2.6.x is supported.
      Data Source Description	A brief description of the data source. The description can be up to 128 characters long.
      Data Source Configuration	Select the environment for the data source: If your business data is separated into production and development environments, select Production + Development Data Source. If your business data is not separated into environments, select Production Data Source.
      Tag	You can add a tag to classify the data source. For more information about how to create a tag, see Manage Data Source Tags.

   2. Configure the connection parameters.

      If you select Production + Development Data Source, you must configure the connection information for the Production + Development Data Source. If your data source is configured as Production Data Source, you only need to configure the connection information for the Production Data Source.

      Note

      Typically, the production and development data sources should be configured as separate instances to ensure environment isolation and reduce the impact of development activities on the production environment. However, Dataphin allows you to configure them as the same data source by using identical parameter values.

      Parameter	Description
      Server address	Enter the IP address and port number of the server. Adding new server entries is not supported.
      dbname (Optional)	Enter the name of the database.
      Authentication method	Select No Authentication or Username+Password. If you select Username+Password, enter the username and password required to access the Milvus instance.
      TLS mode	Currently, only Disable TLS is supported.

5. Select a Default Resource Group. This resource group runs tasks related to the data source, such as data preview and offline data migration.

6. Click Test Connection to verify connectivity, or click OK to save and create the Milvus data source.

   Clicking Test Connection verifies the connection to the data source. If you click OK directly, the system automatically runs a test connection. The data source can be created even if the test fails.

   Test Connection tests the connection for the Default Cluster or Registered Scheduling Clusters that have been registered in Dataphin and are in normal use. The Default Cluster is selected by default and cannot be deselected. If there are no resource groups under a Registered Scheduling Cluster, connection testing is not supported. You need to create a resource group first before testing the connection.

   • The selected clusters are used only to test network connectivity and are not used for running tasks.

   • The test connection usually completes within 2 minutes. If it times out, click the icon to view the reason and retry.

   • Regardless of the test result (Connection Failed, Connection Successful, or Succeeded With Warning), the system records the timestamp of the final result.

     Note

     Only the test results for the Default Cluster include three connection statuses: Succeeded With Warning, Connection Successful, and Connection Failed. The test results for Registered Scheduling Clusters in Dataphin only include two connection statuses: Connection Successful and Connection Failed.

   • When the test result is Connection Failed, click the icon to view the failure reason.

   • When the test result is Succeeded With Warning, the application cluster connection succeeded but the scheduling cluster connection failed. The data source cannot be used for data development and integration. Click the icon to view the log information.