Batch import

更新时间:
复制 MD 格式

DataWorks Data Modeling provides import templates that allow you to create multiple objects, such as models and data metrics, in a single batch operation instead of creating them one by one.

Limits

Only files in the .xlsx format are supported. Each file is limited to 30,000 rows and a maximum size of 10 MB.

Go to the Imported Objects page

  1. Log on to the DataWorks console. In the target region, click Data Development and O&M > Data Modeling in the left-side navigation pane. Select a workspace from the drop-down list and click Go to Data Modeling.

  2. In the top navigation bar of the Data Modeling page, click General Tools.

    On the Imported Objects page, you can create an import task or manage existing import tasks. For more information, see Create an import task or Manage import tasks.

Create an import task

Note

The configuration items vary based on the import task type. The following example uses a data domain import task. You can view configuration items for other import types in the console.

  1. On the Imported Objects page, click Create Import Task.

  2. Select an import object type and download an import template.

    On the Confirm Import Type tab, select the object type to import and download the corresponding template. Then, fill in the template based on your business requirements.

    Note

    After you select an import object type, you can preview the template fields and prepare the required information.

    Import types include data warehouse planning (data domains, business processes), data standard (field standards, standard codes, units of measure, naming dictionaries), dimensional modeling, and data metrics (atomic metrics, modifiers, time periods). For example, the template for a data domain includes fields such as English abbreviation, English name, Chinese name, description, and owner account ID. After you fill in the template, click Next.

  3. Import the object information and check the information.

    On the Data Import tab, upload and preview the data file. You can filter the preview to show only objects with names that conflict with existing objects in DataWorks, which allows you to modify or delete them before importing.

    Note
    • The available Import Mode and Import Status options depend on the selected import type.

      • Import Mode: If an object in the imported file has the same name as an existing object in DataWorks, you can choose to either skip the object or overwrite the existing object with the content from the file.

      • Import Status:

        • Import and Save: Imports and saves the data without creating a new version.

        • Import and Submit: Imports the data and submits it as a new version.

    • Only files in the .xlsx format are supported. Each file is limited to 30,000 rows and a maximum size of 10 MB.

  4. View the import results.

    On the Complete tab, you can view the import results. The page displays statistics about the import task. The Import Result Details table lists the status for each record. Click View More Details next to an item to go to its edit page, or click Continue to Import to start a new import task. If an import failed, troubleshoot the errors based on the details and import the file again.

Manage import tasks

The import page lists all import tasks with their details.

Area

Description

Filter bar

Filter import tasks by Operation Date, Import Type, or Operator.

Task list

View information about each import task, including its status, the amount of data that was successfully imported, and the total amount of data imported in the task. Click View Details to view task details. Note the following:

  • Import Status:

    • Successful: All objects in the task were imported successfully.

    • Failed: All objects in the task failed to import.

    • Partially Successful: Some objects in the task failed to import.

    Identify and troubleshoot the issue based on the failure details.

  • If the values for volume of imported data and Total data volume: do not match, possible reasons include:

    • Some objects failed to import.

    • Some imported objects have names that conflict with existing objects in Data Modeling.

    Troubleshoot the issue based on your actual scenario.

What to do next

After an import task is created, go to the task editing page to perform additional operations as needed.