Databases, tables, and functions

更新时间: 2026-05-01 03:55:10

Metadata management is a critical part of building a data lake. Effective, centralized metadata management helps you maximize the value of your data assets. This topic describes how to manage databases, tables, and functions in Data Lake Formation (DLF).

Databases

Create a database

  1. Log on to the Data Lake Formation (DLF) console.

  2. In the left-side navigation pane, select Metadata > Metadata.

  3. Click the Database tab, select the target Catalogs, and then click Create Database.

  4. Configure the parameters for the database and click OK.

    Parameter

    Description

    Catalog

    Select the data catalog where you want to create the database.

    Name

    Enter a name for the database.

    Description

    Optional. Enter a description for the database.

    Select the path.

    Specify an Object Storage Service (OSS) path to store the metadata. Storing metadata in OSS ensures data security and reliability, and simplifies management and maintenance.

    Note

    Only OSS buckets that use Standard storage are supported. If a Standard storage bucket does not exist in the current region, create one in the OSS console.

View database details

  1. Click the Database tab.

  2. In the database list, click a database name to view its Basic Information.

  3. Click the corresponding tabs to view the Tables, Functions, Data Permission, Overview, and Storage Rule for the database.

Edit a database

  1. Click the Database tab and select the target Catalogs.

  2. In the Actions column for the database, click Modify.

  3. Modify the information and click Update.

    • Description: Enter a description for the database.

    • Select the path.: Enter the location of the database.

Delete a database

  1. Click the Database tab and select the target Catalogs.

  2. In the Actions column for the database, click Delete.

  3. In the confirmation dialog box, click Delete.

Note
  • DLF creates the default database, which cannot be deleted. We recommend that you use other databases for production environments.

  • Deleting a database in the DLF console removes its metadata but does not delete the data stored in OSS. To delete the underlying data, you must run a Drop Database operation from E-MapReduce or MaxCompute.

Tables

Create a table

  1. After you create a database, click the Data Table tab. Select the target Catalogs and Database Name, and then click Create Table.

  2. Configure the parameters for the table and click OK.

    Parameter

    Description

    Table Name

    Enter a name for the table.

    Catalog

    Select the data catalog for the table.

    Database:

    Select a database within the data catalog.

    Table Description

    Optional. Enter a description for the table.

    Data Storage Location

    Select the storage location for the table's data.

    The recommended default storage location is oss://[database_location]/[table_name].

    Format and Serialization

    Select the table's data format. Supported formats include Avro, CSV, JSON, Parquet, and ORC.

    Delimiter

    Optional. If you select the CSV format, specify a delimiter.

    Common Column

    Manually define the table's columns and partition keys. Specify the name, data type, and description for each.

    Partition Key Column

View table details

  1. Click the Data Table tab.

  2. In the table list, click a table name to view its Basic Information.

  3. Click the corresponding tabs to view the Data Permission, Overview, Version Management, and Storage Rule for the table.

    For more information about the Overview of a table, see Table - data overview.

Edit a table

  1. Click the Data Table tab, and select the target Catalogs and Database Name.

  2. In the Actions column for the table, click Modify.

  3. Modify the table information and click Update.

Delete a table

  1. Click the Data Table tab, and select the target Catalogs and Database Name.

  2. In the Actions column for the table, click Delete.

  3. In the confirmation dialog box, click Delete.

Note

Deleting a table in the DLF console removes its metadata but does not delete the data stored in OSS. To delete the underlying data, you must run a Drop Table operation from E-MapReduce or MaxCompute.

Functions

Create a function

  1. In the left-side navigation pane, select Metadata > Metadata.

  2. Click the Function tab. Select the target Catalogs and Database Name, and then click Create Function.

  3. Configure the parameters for the function and click OK.

    Parameter

    Description

    Function Name

    Enter a name for the function.

    Function Type

    Only JAVA is supported.

    Catalog

    Select the data catalog for the function.

    Database:

    Select a database within the data catalog.

    Class Name

    Optional. Enter the class name.

    Resource URI

    Optional. Click Add, and then enter the Type and URI. Supported resource types are JAR, FILE, and ARCHIVE.

View function details

  1. Click the Function tab, and select the target Catalogs and Database Name.

  2. In the function list, click a function name to view its Basic Information.

Edit a function

  1. Click the Function tab, and select the target Catalogs and Database Name.

  2. In the Actions column for the function, click Modify.

  3. Modify the Class Name and click OK.

Delete a function

  1. Click the Function tab, and select the target Catalogs and Database Name.

  2. In the Actions column for the function, click Delete.

  3. In the confirmation dialog box, click Delete.

上一篇: Data catalog 下一篇: Data overview of data tables
阿里云首页 数据湖构建 相关技术圈