Step 2: Real-time project planning
Create and bind Ververica Flink compute sources, data sources, and a real-time project for this tutorial.
Step 1: Create Ververica Flink compute source
-
On the Dataphin home page, click Planning in the top menu bar.
-
Follow the image below to open the Ververica Flink New Compute Source page.
-
On the New Compute Source page, fill in the required parameters.
Parameter
Description
Compute Type
Choose Ververica Flink as the compute type.
Region
Select the region of the compute source, such as China (Hangzhou).
Access Method
Choose the access method for the compute source. VPC network is recommended.
Accesskey ID, AccessKey Secret
Provide the AccessKey ID and AccessKey Secret for an account with access to the fully managed Flink project.
Retrieve the AccessKey ID and AccessKey Secret from the User Information Management page.
Flink Workspace ID
Select the Flink Workspace ID associated with the Ververica Flink compute source, typically flink_dataphin_default.
Flink Project Space
Choose the Project Space for the Ververica Flink compute source.
Compute Source Name
Enter the name flink_dataphin for the compute source.
Description
Enter a description, such as Real-time R&D demo.
-
Click Validate And Submit. The system verifies connectivity and creates the compute source.
Step 3: Create project
-
Follow the image below to open the New Project dialog box.
-
In the Production Development Type step, select Basic Mode and click Next.
-
In the New Project dialog box, configure the following parameters:
Parameter
Description
Business Unit
Leave blank.
Project English Name
Enter flink_dataphin.
Project Name
Enter the project name flink_dataphin.
Compute Source Type
Activate the real-time engine and select the Ververica Flink compute source. For the Flink stream processing compute source, choose the previously created flink_dataphin compute source.
Space Type
Choose General Layer.
Security Settings
Use the default configuration.
More Settings
Use the default configuration.
-
Click OK to create the real-time project.
Step 4: Create data source
-
On the Dataphin home page, select Management Center from the top menu bar.
-
Follow the image below to open the New Data Source dialog box.
-
In the Relational Data Source section, select MySQL.
-
In the New MySQL Data Source dialog box, configure the following parameters:
Parameter
Description
Data Source Name
Enter the name flink_dataphin for the data source.
Version
Select the version, for example, MySQL8.
Data Source Description
Enter a description, such as Source data for real-time R&D.
Datasource Config
Choose the "production" Data Source configuration.
Tag
Leave as the default option, Not Filled.
JDBC URL
Enter the JDBC URL in the format
jdbc:mysql://host:port/dbname. You can find thehost:portdetails on the MySQL instance product page, as illustrated below:
Important-
Ensure Dataphin's IP is added to the database whitelist to avoid connection issues. For details on how to do this.
-
If using an internal network address, ensure that the database and Dataphin instance are in the same region. For additional information.
Username, Password
Enter the username and password for the data source.
SSL Encryption
If SSL encryption is enabled for your MySQL data source, select Enable, then Upload Truststore Certificate, and enter the Truststore Certificate Password.
Type
Choose ApsaraDB as the type.
NoteThe access method should correspond to the network type selected during database creation.
For a Public Network Database, select a database accessible over the public network.
ApsaraDB refers to a database hosted on Alibaba Cloud.
For an ECS (VPC) Self-managed Database, choose a self-managed database within a VPC.
Advanced Settings
Use the default configuration.
-
-
Click Test Connection to verify connectivity.
-
After the test succeeds, click OK to complete the data source setup.