Data standard overview-Dataphin(Dataphin)-阿里云帮助中心

Dataphin helps you create and manage data standards to standardize data production and management. This reduces the cost of data application and processing.

Quick start in 5 minutes

Background information

The goal of data standards is to support business, technology, and management. Data standard management is the process of defining and applying standardized definitions for data and its properties. The definition of a data standard must meet the company's business application and management needs. The definition process should reference internal and external regulatory standards, such as international, national, regulatory, industry, and internal company standards.

Business: Standardizing entity data resolves issues such as data inconsistency, incompleteness, and inaccuracy. It removes ambiguity and provides a global data definition within the enterprise. This reduces communication costs between departments and systems and improves business processing efficiency. A unified system of data metrics allows business users to easily access data and perform self-service data analytics. This enables data-driven business innovation.
Technology: Unified and standard data and data structures are the foundation for information sharing in an enterprise. Standard data models and data support new systems and improve the efficiency of application system development and implementation. Data standardization defines clear Data Quality rules, data sources and destinations, and validation rules to improve Data Quality.
Management: Standardizing data definitions clarifies data ownership, which ensures data security and Data Quality. A unified system of data metrics supports data analytics on various subjects. It improves the efficiency of data processing and analysis. It provides proactive prompts, in-process alerts, and post-event reminders for business metrics. This enables data-driven management and allows decision-makers to quickly obtain information for decision-making.

Prerequisites

You must have purchased the Data Standard value-added service. For more information, see Activate Dataphin.

Scenarios

An IT team at a company creates a data standard for employee gender: `male` for men, `female` for women, and `unknown` for unknown.

First, a data standard administrator creates a gender lookup table and syncs it with developers. The administrator then creates the employee gender standard, references the gender lookup table for the value range, and adds a monitoring rule for field value range validation. Finally, the administrator creates a mapping rule.
When creating an integration node, a developer queries the gender lookup table. The developer uses the Field Calculation widget to transform non-standard field values from the source table, such as 0, 1, man, and woman, into `male`, `female`, and `unknown`. Then, on the quality rules page for the target table, the developer references the monitoring rule created for the employee gender standard and configures a schedule. After the node runs, a quality alert indicates that the field value transformation from the source table failed because of non-standard records. The developer then manually corrects the target table.

Core concepts

Term	Description	References
Data standards set	A data standard set is a collection of standards that have similar or identical specifications and related business meanings. It defines information such as management and view permissions, and approval templates for the publishing flow for the data standards within the set. This allows for more precise control over data standards. Each data standard must belong to a single data standard set and follows the multi-level classification of the folder where the set is located.	Create and manage a data standard set
Standard template	A standard template does not define a standard. Instead, it defines the unified specifications and constraints that data standards created from it must follow. In other words, it defines the standard properties. Standard properties mainly include business, technical, and management properties. They can be extended to include master data, Data Quality, and lifecycle management properties. To create a data standard, first select a standard template and a data standard set. Then, fill in the standard property values based on the details defined in the template.	Create and manage a standard template
Data standard	A data standard provides services and support for business, technology, and management. Data standard management is the process of defining and applying standardized definitions for data and its properties.	Create and manage a data standard
Mapping rule	By defining the matching relationship between standard properties and metadata fields of an Asset object, you can map and associate standards with Asset objects. This is a prerequisite for assessing the standard compliance of an Asset object.	Create and manage a mapping rule
Assessment details	Based on the mapping rule and monitoring configurations, the mapping relationship between data standards and Asset objects and the corresponding assessment results are displayed from both the standard and Asset object perspectives. These details can be used as a basis for assessing the asset standard adoption rate and for promoting rectification of development specifications.	View assessment details

User roles and permissions

Note

You can query only the standards that you have permission to view. The standards you can view include published standards in public data standard sets that you have not joined, all standards in data standard sets that you have joined, and all standards in data standard sets that are designated as visible to you.

User member type	Role type	Description
Super administrator	System role	A super administrator can designate data standard administrators. In the Data Standard module, a super administrator has the same permissions as a data standard administrator and is responsible for the following: Create and manage data standard sets. Designate maintainers, members, visibility scope, and approval templates for each data standard set. Create and manage standards. Upload data standards in batches. Add and manage all lookup tables, and view their references. Add and manage all roots. Add and manage public data standard set properties. Create and manage mapping rules. View details for all rejections triggered by executed rules. View the execution logs of all mapping rules. Create and manage data standard set folders. Create and manage custom public standard properties. View and manage all confirmed and invalid mappings between standards and Asset objects. Create and manage standard templates. Create and manage standard documents.
Data standard administrator	System role	A data standard administrator has permissions to view, operate, and manage all data standards and is responsible for the following: Create and manage data standard sets. Designate maintainers, members, visibility scope, and approval templates for each data standard set. Create and manage data standards. Upload data standards in batches. Add and manage all lookup tables, and view their references. Add and manage all roots. Add and manage public data standard set properties. Create and manage mapping rules. View the assessment details of all successfully executed mapping rules. View the execution logs of all mapping rules. Create and manage data standard set folders. Create and manage custom public standard properties. View and manage all confirmed and invalid mappings between standards and Asset objects. Create and manage standard templates. Create and manage standard documents.
Data standard set maintainer	Functional role	A data standard set maintainer is responsible for the routine maintenance of data standard sets, including the following: Edit and delete the data standard sets they can maintain. Add, delete, modify, and query data standard set properties. Create standards in the data standard sets they maintain. After creation, they can only edit or delete the standards they own. Upload data standards in batches to their assigned data standard sets. View lookup table lists and their references. View published roots and lookup tables. They can edit and delete the lookup tables they own. View the execution logs and assessment details of successfully executed mapping rules for the data standard sets they have permission to view. View public standard properties and the public standard property list.
Data standard set member	Functional role	A data standard set member is mainly responsible for creating standards (by adding new ones or cloning existing ones) in the data standard sets they have joined. They manage the standards they own. After creation, they can only edit or delete the standards they own. You can batch upload data standards to the associated data standard set. View published roots and lookup tables. They can edit and delete the lookup tables they own. View system standard set properties. View lookup table references. View the public standard property list.
Standard owner	Data role	A standard owner is one of the four user member types: super administrator, data standard administrator, data standard set maintainer, or data standard set member. In addition to the permissions of their corresponding role, they can perform the following operations: Edit, submit for publishing, unpublish, and delete the standards they own. View the assessment details for the standards they own. Manage the confirmed and invalid mappings between the standards they own and Asset objects.
Selection Rule Owner	Data role	View published mapping rules. Edit and delete the mapping rules they own. View the execution logs and assessment details of successfully executed mapping rules for their assigned data standard sets. View lookup table references. View the public standard property list.
Lookup table owner	Data role	Edit and delete the lookup tables they own. View lookup table references. View the public standard property list.
Other system roles and regular members	System role	View published standards (active, pending, or expired) in data standard sets they have permission to view. View published roots and lookup tables. View lookup table references. View the public standard property list.

Data standard process guide

The data standard process guide helps you understand the configuration workflow for data standards. The general process is as follows:

Create a standard template -> Create a data standard set -> Create a data standard -> Request to publish the standard -> The standard is approved -> Create a mapping rule -> View mapping results.

On the Standard page, click Process Guide to open the Help Guide dialog box. If the data standard set or data standard lists are empty, click View Guide to open the dialog box.
In the Help Guide dialog box, you can create data standard sets, data standards, lookup tables, and roots. You can also view the data standard process guide and a mapping rule configuration example.

Data standard entry point

On the Dataphin home page, select Administration > Data Standard from the top menu bar.

On the Data Standard page, the navigation pane on the left shows the entry points for each functional module.

Primary menu	Secondary menu	Description
Data Standard	Data Standard	A list of data standards. You can view all standards in the data standard sets that you have joined.
Data Standard	Data Standard Set	A list of data standard sets.
Implementation Assessment	Mapping Rule	A list of mapping rules configured based on data standard set properties and Asset object metadata properties. This includes the configuration of the scope where the mapping rules take effect.
	Mapping	A list of mappings between Asset objects and data standards. This includes confirmed mappings and mappings designated as invalid. You can view the mappings in two modes: summarized by asset granularity or tiled to show all mappings. You can configure Data Quality monitoring rules for confirmed mappings.
	Assessment Details	Displays the assessment details for all standards and Asset objects involved in mapping and assessment. You can view the details from two perspectives: the standard perspective and the Asset object perspective.
	Execution Records	Displays the execution details and operational logs for mapping rules.
Reference Data	Lookup Table	A list of lookup tables. You can view the details of each lookup table.
	Root	A list of roots. You can view the details of each root.
	Standard Document	A list of standard documents. You can view the details of each document.
General Configurations	Public Standard Property	A list of public standard properties, including custom and system properties.
	Standard Template	A list of standard templates. You can view the property details of each template and the data standards created using it.
	Detection Feature	A list of detection features, including custom and built-in system features.

上一篇: Data Standards 下一篇: Data standard