Batch import and export of asset topics

Limits

• Batch import or export of asset topics is only supported by the Intelligent R&D Edition and Asset Operation - Pro/Standard Edition.

• The maximum concurrency for file import or export tasks is 5.

• Only records with a successful status can be downloaded. Export files are saved for 7 days, after which they are no longer available for download.

• A maximum of the 50 most recent import or export records of asset topics are retained.

Permission description

• Super administrators, operation administrators, and custom global roles with Catalog Design - Management permissions can batch import or export asset topics, view import details, and download export files.

• Topic administrators can batch import or export asset topics, view import details, and download export files for the asset topics they manage.

Batch import of asset topics

1. Select Asset > Directory Management from the top menu bar of the Dataphin home page.

   You can import asset topics and directories in batch for various assets. The methods for importing indicator, API, dashboard, and table topics are identical. For illustration, consider the example of table topics.

2. In the left-side navigation pane, select Catalog Design > Catalog Design. On the directory planning page, click the Table Directory tab.

3. On the Table Directory tab, click Batch Management - Batch Import Directory at the bottom of the topic list or click the drop-down arrow next to the Edit Directory button in the directory list to select Batch Import Directory.

4. In the Batch Import Directory dialog box, configure the parameters.

   Parameter	Description
   STEP 1 Download Configuration Template--New
   Configuration Template	If there is no template, click the file name or downloadicon to download the .xlsx file. If there is already a template, you can directly upload the configuration file and import it.
   STEP 1 Download Configuration Template--Update
   Asset Topic	Supports selecting asset topics that the current account has management permissions for. Multiple selections are supported.
   Directory Version	Export directory templates based on the selected asset topics. Supports selecting two directory versions: editing (automatically filters deleted directories) and published. Editing (automatically Filters Deleted Directories): Export directories under the selected asset topics that are not in a deleted state (i.e., do not include pending publication (deleted) or rejected (deleted)). Published: Export directories under the selected asset topics that have been published.
   Configuration Template	Generated based on the selected asset topic range. Click Generate Template to generate a template file in .xlsx format. You can click the file name or downloadicon to download the .xlsx file. If there is already a template, you can directly upload the configuration file and import it.
   STEP 2 Upload Configuration File
   Upload File	Only .xlsx files are supported for upload. If the workbook contains multiple sheets, the system only parses the content of the first sheet. File size should not exceed 20 MB. When filling out the template, please refer to the template instructions. During import, uniqueness and compliance checks will be performed based on directory names. Worksheet Details: Do not delete the instruction and title rows. The system will start parsing from the third row. Do not modify or delete column names, as this may cause the template to be unparseable, resulting in import failure. Delete example rows before filling out. If the topic does not exist and the operating user has permission to create new topics, the topic will be automatically created. The default visibility is set to all users. You can manually adjust it after import. Editing or deleting topics is not supported at this time. The content of the configuration file is parsed line by line in order. If you need to change multiple levels of directories, each level must have a separate record. If creating a new directory, fill in the parent directory first, then the subdirectory. Otherwise, the creation may fail due to the parent directory not being found. If deleting, fill in the subdirectory first, then the parent directory. Original Directory ID: The system determines whether the operation is an addition or update based on whether the original directory ID is empty. If the original directory ID exists but all hierarchical directory configurations of the new directory are empty, it is considered a directory deletion. If the directory already contains assets, the association will be automatically dissociated.

5. After uploading the file, the system will validate it according to the uploaded file's specifications. Once validated successfully, click Start Import to parse the topic name, original directory ID, and new directory for this import.

   • Topic Name: Validates whether the topic name in the import file is empty.

   • Original Directory ID: Validates whether the original directory ID in the import file is empty.

   • New Directory: Validates whether the full path of the new directory in the import file is empty or complete.

6. After validation, access the import results page.

   Parameter	Description
   Import Results	Supports viewing import progress, import results, and running time.
   Abnormal Records	Displays directory records that failed validation and could not be imported, including the corresponding line number in the original file, topic name, original directory name/ID, new directory name, and abnormal prompts. In the Abnormal Records tab, you can click Download Abnormal Records to download the corresponding original records as a file. Modify them according to the abnormal prompts and re-import them.

   Once the import is complete, you can quickly view the import results by closing the import configuration dialog box. Closing the dialog box will not stop the import task. You can check the historical import records you want to review on the Table Directory tab by clicking Batch Management - Batch Operation Records.

Batch export of asset topics

You can batch export asset topics and directories for various assets. Export procedures for indicator topics, API topics, dashboard topics, and table topics are identical. For illustration, consider the example of table topics.

1. On the Table Directory tab, click Batch Management - Batch Export Directory at the bottom of the topic list or click the drop-down arrow next to the Edit Directory button in the directory list to select Batch Export Directory.

2. In the Batch Export Directory dialog box, configure the parameters.

   Parameter	Description
   Asset Topic	Supports selecting asset topics that the current account has management permissions for. If performing a batch import operation from a certain asset topic, the system automatically fills in the currently located asset topic. Multiple selections are supported.
   Directory Version	Export directories based on the selected asset topics. Supports selecting two directory versions: editing (automatically filters deleted directories) and published. Editing (automatically Filters Deleted Directories): Export directories under the selected asset topics that are not in a deleted state (i.e., do not include pending publication (deleted) or rejected (deleted)). Published: Export directories under the selected asset topics that have been published.

3. Click OK to complete the directory export.

   If the content of the exported asset topics is large, file generation may take some time. You can view the export operation information and download the export file in Batch Management - Batch Operation Records.

Batch operation records of asset topics

You can view the import and export operation record details for each asset topic. The batch operation viewing methods for indicator topics, API topics, dashboard topics, and table topics are identical. The following example uses table topics.

1. On the Table Directory tab, click Batch Management - Batch Operation Records at the bottom of the topic list or click the drop-down arrow next to the Edit Directory button in the directory list to select Batch Operation Records.

2. In the Batch Operation Records panel, view the import and export operation records of asset topics.

   • Batch Import: Displays the operation record details of asset topic imports, including ordinal number, creator, import status, creation time, and end time. You can also click the View icon in the operation column to see import details.

   • Batch Export: Displays the operation record details of asset topic exports, including ordinal number, creator, export scope, export status, creation time, and end time. You can also click the Download icon in the operation column to download the export file locally.