Terms
Learn about fundamental data quality concepts, including data objects, quality rules, hard rules, and soft rules.
| Concept | Description |
| Quality rule | A rule that validates data objects across one or more fields. For example, monitoring row count changes in a table and checking for primary key duplication can each be defined as a quality rule. |
| Hard rule | A quality rule whose validation outcome critically affects downstream nodes. If a hard rule detects an anomaly, the scheduling of downstream nodes is halted, the current node is marked as failed, and an alert is sent to the designated quality alert recipient. |
| Soft rule | A quality rule whose validation result does not affect downstream nodes or halt their scheduling. An abnormal soft rule validation triggers an alert to the quality alert recipient without stopping the schedule. |
| Validation record | A log of periodic validation outcomes for data quality rules. |
| Quality report | A summary of periodic validation results for quality rules applied to a data table in the production scheduling environment. The quality report details the validation outcomes for each quality rule associated with the table. |
| Partition filter expression | An expression that defines the data range for a quality rule based on timestamp criteria. |