Quality rule template type

Template Classification

Template Description

Completeness

Null Value Validation

Checks whether a field contains null values.

Empty String Validation

Checks whether a field contains empty strings.

Uniqueness

Uniqueness Validation

Checks whether the values in a field are unique.

Field Group Count Validation

Validates the count of distinct values in a field.

Duplicate Value Count Validation

Detects duplicate and redundant values in a field.

Timeliness

Time Comparison With Expression

Compares a field's timeliness against the data timestamp.

Time Interval Comparison

Measures the time difference between two columns within the same table.

Time Interval Comparison In Two Tables

Assesses the time difference between two columns across different tables.

Validity

Column Format Validation

Validates the format of a field by using an expression or regular expression.

Column Length Validation

Validates the length of a field.

Column Value Domain Validation

Checks whether the values of a field fall within a specified range.

Reference Table Validation

Checks whether a field's value exists in a lookup table.

Standard Reference Table Validation

Checks whether a field's value exists in a lookup table. You can select lookup tables from the data standard module.

Consistency

Columns Value Consistency Validation

Compares the initial values of two fields within the same table.

Columns Statistical Consistency Validation

Compares statistical values, such as sums and maximum values, of two fields within the same table.

Single Field Business Logic Consistency Comparison

Validates the correctness of complex business logic involving multiple fields within the same table.

Columns In Two Tables Value Consistency Validation

Compares the initial values of two fields across different tables.

Columns In Two Tables Statistical Consistency Validation

Compares statistical values, such as sums and maximum values, of two fields across different tables.

Columns In Two Tables Processing Logic Consistency Validation

Validates the correctness of complex business logic involving multiple fields across different tables, such as total sales amount = unit price * quantity.

Cross-Source Columns Statistical Consistency Validation

Validates complex business logic for two fields across tables from different data sources.

Stability

Table Stability Validation

Validates a table's size and row count stability by comparing statistical results with static fields.

Table Volatility Validation

Measures a table's size and row count volatility by comparing statistical results with historical data.

Column Stability Validation

Validates a field's average and maximum value stability by comparing statistical results with static fields.

Column Volatility Validation

Measures a field's average and maximum value volatility by comparing statistical results with historical data.

SQL

Custom Statistic Validation

Validates custom statistical indicators for a table. Both static field and volatility comparison methods are supported.

Custom Detail Value Validation

Runs custom validation on detailed table data to count normal and abnormal rows, and supports data archiving for detected anomalies.

Template Classification

Template Description

Stability

Data Source Connectivity Monitoring

Monitors data source connectivity to ensure consistent access.

Table Structure Change Monitoring

Monitors table metadata for structural changes.

Template Detail Classification

Description

Consistency

Stream-Batch Comparison

Compares real-time and offline data under the same statistical logic, flagging significant discrepancies for investigation and resolution.

Multiple Stream Links Comparison

• Enables high availability by building multiple links for swift switching when data anomalies occur.

• Monitors data calculation progress across multiple links to detect data lag and statistical drift.

Stability

Real-time Statistical Value Detection

• Validates indicator values or statistical data in real time.

• Supports comparison with static fields or historical data for validation.