Access DLF with Flink SQL

Prerequisites

• You have a fully managed workspace for Realtime Compute for Apache Flink. If you have not created one, see Activate Realtime Compute for Apache Flink.

• Ensure that your Realtime Compute for Apache Flink workspace and DLF are in the same region. You must also add the workspace's VPC to the DLF whitelist. For more information, see Configure a VPC whitelist.

Limitations

Only Ververica Runtime (VVR) 11.1.0 or later supports connecting to a DLF catalog.

Create a DLF catalog

For more information, see Get started with DLF .

Register the catalog in Flink

1. Log on to the Realtime Compute console.

2. In the list of fully managed workspaces, click the name of your workspace to open its console.

3. You can register the catalog by using the UI or by running SQL commands.

   UI

   1. In the navigation pane on the left, click Catalogs.

   2. On the Catalog List page, click Create Catalog.

   3. Select Apache Paimon and click Next.

   4. Set metastore to dlf. For catalog name, select the desired DLF catalog. Click OK to create the catalog.

   SQL commands

   In the Scripts editor, enter and run the following SQL statement to create the catalog.

   CREATE CATALOG `flink_catalog_name` 
   WITH (
     'type' = 'paimon',
     'metastore' = 'rest',
     'token.provider' = 'dlf',
     'uri' = 'http://cn-hangzhou-vpc.dlf.aliyuncs.com',
     'warehouse' = 'dlf_test'
   );

   The following table describes the parameters.

   Parameter	Description	Required	Example
   type	The type of the catalog. This parameter is fixed to paimon.	Yes	paimon
   metastore	The type of the metastore. This parameter is fixed to rest.	Yes	rest
   token.provider	The token provider. This parameter is fixed to dlf.	Yes	dlf
   uri	The URI for accessing the DLF REST Catalog Server. The format is http://[region-id]-vpc.dlf.aliyuncs.com. For more information about region IDs, see Endpoints.	Yes	http://cn-hangzhou-vpc.dlf.aliyuncs.com
   warehouse	The name of the underlying DLF catalog to use as the warehouse.	Yes	dlf_test

Common errors