Manage data quality objects

Updated at:

If an imported deployment package contains changes to data quality objects, they appear on the Data Quality page, where you can manage and deploy them.

Access data quality objects pending deployment

  1. Log on to Dataphin with an account authorized for cross-tenant deployment.

  2. On the Dataphin homepage, choose Management Center > cross-tenant deployment in the top navigation bar.

  3. In the left-side navigation pane, choose cross-tenant deployment > Import Deployment Package.

  4. In the Actions column of the target deployment package, click the image Deploy icon.

  5. Click the Data Quality tab to view the objects pending deployment.

View and manage data quality objects pending deployment

After the deployment package is imported, you can manage rule templates and quality rules on the Data Quality tab. These operations include filtering, deploying, viewing details, comparing versions, and viewing deployment details. The available operations vary depending on the object type.

Note

Because data quality objects have many complex dependencies, deploy them in the order specified in the Instructions in the upper-right corner of the page. For more information about the deployment order of a deployment package, see Recommended Deployment Order.

Actions

Description

Filter

You can perform a fuzzy search by object name or filter objects by criteria such as Modification Time, deployment status, change type, and environment change.

  • Batch Search: You can click Batch Search and enter supported search terms for the objects in the Batch Search dialog box. You can enter up to 1,000 items, separated by line breaks. After you click OK, the system performs an exact search and displays the matching objects in the list.

  • Filter:

    • Modification Time: Select a start date and an end date. The date and time format is YYYY-MM-DD hh:mm:ss.

    • deployment status: You can select one or more deployment statuses. The available statuses are To be Deployed, In Queue , Deploying, Deployment Succeeded, Deployment Failed, and Succeeded with Risks. In Queue indicates the object is waiting in the deployment queue. Succeeded with Risks indicates a successful deployment where the deployed content differs from the imported content. This status indicates a potential risk but does not affect the object's usability.

    • change type: You can select one or more change types. The available types are New, Update, and Delete. For more information, see Change Type Description.

    • environment change: Indicates whether the target environment changed since the last import.

    • Validation Object Type: You can filter objects by this criterion only for quality rule objects.

Deploy

You can redeploy objects with a Deployment Failed or To be Deployed status, either individually or in batches. Objects with a status of Deployment Succeeded do not need to be redeployed.

  • Single deployment: In the Actions column of the target object, click Deploy. In the dialog box that appears, enter a name for the deployment (up to 64 characters), and click OK.

  • Batch deployment: Select the checkboxes next to the target objects, or click Select All or Select Current Page at the bottom of the page. After selecting the objects, click Deploy at the bottom of the page. In the dialog box that appears, enter a name for the deployment (up to 64 characters), and click OK.

    Note

    Select All applies to all objects that match the current filter and search criteria. Select Current Page applies only to the objects on the current page.

View details

Displays the details of a specific object in the target environment.

Note

If the change type is Delete and the deployment status is Deployment Succeeded, the object no longer exists in the target environment. In this case, you cannot view its details.

version comparison

This operation is available only when the change type is Update. This operation compares the imported object version (from the deployment package in the source environment) with the latest version in the target environment.

deployment details

In the deployment details dialog box, you can view basic information, process validation results, and exception alerts.

  • Process validation

    • dependency check

      • rule template: If the change type is New or Update, the system checks whether the data sources for the Dataphin tables and global data tables referenced in the rule template exist in the target environment.

      • quality rule: If the change type is New or Update, the system checks whether the rule template, dependent tables, internally dependent objects, and business properties used by the quality rule exist in the target environment.

    • Deployment validation

      • rule template: This check verifies that the deployment was successful. In addition to rerunning the pre-checks, the system checks the number of rule templates for New or Update changes, and confirms the object's deletion for Delete changes.

      • quality rule: This check verifies that the deployment was successful. In addition to rerunning the pre-checks, the system checks the number of quality rules for New or Update changes, and confirms the object's deletion for Delete changes.

    • monitored object: This check is available only for quality rule objects and verifies whether the monitored object exists in the current environment.

  • Exception alert: Displays exception details for some validation items.