2022 release notes

Updated at:

This page contains the 2022 release information for Dataphin.

November 2022

Feature name

Description

Release date

Release region

Related documents

Dataphin Free Trial

You can apply online for a 30-day Free Trial of the Dataphin Intelligent R&D Edition, which includes Asset Quality, Intelligent O&M, Data Standard, Asset Security, and Resource Governance.

November 22, 2022

China North 2 (Beijing)

Apply for a Dataphin Free Trial

China East 1 (Hangzhou)

China South 1 (Shenzhen)

China East 2 (Shanghai)

October 2022

Feature name

Description

Release date

Release region

Related documents

Resource usage details

  • You can now view the specifications of available data processing units.

  • Adds usage statistics for Data Standard and Intelligent O&M.

October 25, 2022

China North 2 (Beijing)

View Resource Usage

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Data source

  • Adds support for DM (Dameng) Data Sources.

  • Adds dependency checks for Data Source deletion.

  • The Kafka Data Source now supports username and password authentication for the commercial version of Confluent and enables SSL for this authentication mode.

October 25, 2022

China North 2 (Beijing)

Create DM Data Source, Create Kafka Data Source

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Data architecture

The Subject Area feature is enhanced. You can now create up to five levels of subject areas and visualize their hierarchy in a tree or on a graphical dashboard.

October 25, 2022

China North 2 (Beijing)

Data Warehouse Planning Overview

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Conceptual modeling

  • You can now visualize business processes.

  • You can now configure relationship types between Business Objects and Business Activities.

  • You can now create enumerated and virtual Business Objects and associate them when creating related Logical Tables.

  • The Logical Table feature is enhanced with several optimizations, including improved submission details, support for using max partitions in Derived Metrics, and a streamlined creation process.

October 25, 2022

China North 2 (Beijing)

Standard Modeling Overview

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Development features

  • Optimized the Development Menu Tree and Editor for an improved user experience.

  • Enhanced the editor experience, Version Comparison, and Scheduling Parameter features.

  • You can now reference global variables in code tasks.

  • You can now request permissions and require deployment approvals for sensitive variables.

October 25, 2022

China North 2 (Beijing)

Data Development Overview, Scheduling Configuration

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Offline development

  • Adds support for the load overwrite syntax.

  • Improved resource file referencing in code tasks.

  • Improved Ad-hoc Query performance, reducing wait times for scheduled resources.

October 25, 2022

China North 2 (Beijing)

Manage Compute Jobs, Create SQL Task, Query and Download Data

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Real-time development

The open-source Flink engine now supports custom real-time connectors. Flink engine version 1.14 also supports CDC connectors for MySQL and PostgreSQL.

October 25, 2022

China North 2 (Beijing)

Create Flink SQL Task, Create Metatable, Create Mirrored Table

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Operations center

  • You can now quickly filter for suspended scheduled tasks and their downstream nodes.

  • For selected suspended tasks, you can now set their run mode to Dry Run, Normal Run, or Suspend.

  • For the open-source Flink engine, you can now view task run analysis within the Dataphin platform.

  • Introduces the Baseline O&M feature, which includes Baseline Monitoring, Baseline Alerts, Baseline Instances, and high-priority task assurance.

  • You can now diagnose the root cause of exceptions for offline periodic Instances and Data Backfill Instances.

  • Optimized the resource allocation logic for Rerun, Forced Rerun, Data Backfill, and SQL tasks.

October 25, 2022

China North 2 (Beijing)

Overview

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Introduces a new value-added Intelligent O&M module, which includes Scheduling Throttling and Baseline O&M.

October 25, 2022

China North 2 (Beijing)

Baseline Monitoring Configuration, Scheduling Configuration, Billing Description

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Data standard

  • Adds support for configuring attributes for standard sets, and for batch importing, downloading, and managing the publication of Data Standards, Code Tables, and Word Roots.

  • Introduces configuration management for Standard Mapping Rules.

  • Adds full lifecycle management for Data Standard sets, including creation, publishing, approval, and decommissioning.

October 25, 2022

China North 2 (Beijing)

Data Standard Overview, Create and Manage Standard Mapping Rules, Create and Manage Standard Sets, Create and Manage Data Standards, Create and Manage Standard Codes (Code Tables), Create and Manage Word Roots

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Asset security

  • Adds support for configuring underlying and display-only Data Masking.

  • Classification Rules now support field name Blocklists. Operational instructions for Classification Rules, Data Masking Rules, and Whitelists are now provided.

  • Security algorithms now support automatic updates and batch operations.

  • You can now automatically install security policy algorithm packages for the security module and view installation logs.

  • Adds new encryption and decryption algorithms, and you can now use them in your jobs.

  • Key Management now supports encryption and decryption keys.

  • Enhanced the production security mode and extended production data protection to Basic projects.

October 25, 2022

China North 2 (Beijing)

Manage Dynamic Data Masking Rules, Project Security Policy, Asset Security Overview, Data Masking Algorithm, Manage Keys

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Data quality

  • Adds quality monitoring for tables from various Data Sources. You can also monitor Data Source connectivity and table structure changes.

  • Provides a rich set of built-in Quality Rule templates.

  • The Asset Report is upgraded. You can now view and analyze quality summaries at the resource level and download exception data for archiving.

  • Enhanced the permissions for the Quality Owner Role. This role can now create, edit, and delete Quality Rules, and execute rule trial runs.

  • Optimized the process for adding Quality Rules and enhanced support for various data types in Oracle, PostgreSQL, SQL Server, and SAP HANA.

  • Introduces the Global Quality module. Real-time Quality now supports Apache HBase.

October 25, 2022

China North 2 (Beijing)

Asset Quality Overview, Create Data Table Quality Rule

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Compute engine

Dataphin can now process data in a Lakehouse architecture based on MaxCompute and Data Lake Formation (DLF).

October 25, 2022

China North 2 (Beijing)

Set Compute Engine for Dataphin Instance

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Data integration

  • The API Input Component now supports reading from data sources.

  • Increased the maximum upload file size for the CSV Input Component from 50 MB to 500 MB.

  • Data Integration now supports Kafka and DataHub Data Sources.

  • You can now copy table names in input and output components.

  • When you use one-click table creation to a project's engine source, metadata is now automatically synchronized to Assets.

  • SAP HANA now supports cross-schema reads.

  • MongoDB databases now support Chinese character field names and handle fields that store invalid floating-point NaN values.

  • The FTP Input Component now supports processing rules for empty files and configuration of the content start line.

  • You can now use Script Mode to configure integration tasks and use OTS (Open Table Service) Data Sources.

  • Adds new Component templates for ClickHouse, Kafka, DataHub, Kudu, and DM (Dameng). These templates adapt to project compute source templates across different engines.

  • You can now perform read and write operations on Elasticsearch Data Sources in Script Mode.

October 25, 2022

China North 2 (Beijing)

Configure API Input Component, Create Kafka Data Source, Create DataHub Data Source, Create SAP HANA Data Source, Create MongoDB Data Source, Configure MaxCompute Input Component, Configure MaxCompute Output Component, Manage FTP Component, Manage Script Mode Input Component

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Asset permissions

Introduces a Permission Audit module that allows you to audit your own permissions.

October 25, 2022

China North 2 (Beijing)

Permission Operation Audit

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Data service

  • Optimized API service performance and added network configuration instructions.

  • The API Search Box now supports searching by API name or API ID.

  • Supports front-end watermarking.

  • Adds support for Hologres Data Sources.

  • You can now use parameters in calculations within the SELECT clause.

October 25, 2022

China North 2 (Beijing)

Configure Network, Data Service Overview

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Home

  • Introduces global navigation, an enhanced menu tree, tabbed pages, and overall visual improvements.

  • Supports in-app prompts for built-in help documentation.

October 25, 2022

China North 2 (Beijing)

None

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Data warehouse planning

Adds permissions for creating Business Objects and Business Activities.

October 25, 2022

China North 2 (Beijing)

Overview

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Offline compute task

  • Optimized pre-compilation performance.

  • Adds descriptions for time parameters.

October 25, 2022

China North 2 (Beijing)

Data Development Overview

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

DML operations for Logical Tables now support partial-field inserts and dynamic partitions.

October 25, 2022

China North 2 (Beijing)

Create and Configure Regular Dimension Logical Table, Create and Configure Hierarchy Dimension Logical Table, Create Virtual Dimension Logical Table

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

  • SQL tasks now support cost, reload function, EXCEPT ALL, and the set yarn.timeline-service.enabled=true syntax.

  • SQL tasks now support CLONE TABLE.

October 25, 2022

China North 2 (Beijing)

DML Operations

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

Project configuration

Optimized project visitor permissions by introducing the Data Visitor and General Visitor Roles.

October 25, 2022

China North 2 (Beijing)

Manage Permissions and Compute Sources for Project Space

October 27, 2022

China East 1 (Hangzhou)

November 01, 2022

China South 1 (Shenzhen)

November 03, 2022

China East 2 (Shanghai)

July 2022

Feature

Description

Release date

Release region

Related documents

Billing

Introduces two new editions: Basic Development Edition and Agile Development Edition.

July 19, 2022

China North 2 (Beijing)

Purchase Guide

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Data architecture (formerly Business Segment)

  • The Business Segment is upgraded to the Data Section, and Data Domains are renamed to Subject Areas.

  • Dimensions and Business Processes have been moved to the Data Architecture module and consolidated under Conceptual Design. "Dimension" is renamed to "Business Object," and "Business Process" is renamed to "Business Activity". Business Activities now include three subtypes: Event, Business Workflow, and Business Snapshot.

  • Public Definitions now support hourly and minute-level statistical periods.

July 19, 2022

China North 2 (Beijing)

Overview of Data Warehouse Planning

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Member management

  • You can now assign System Roles to users in the Member Management module. Available roles include System Administrator, Data Source Administrator, Security Administrator, and Asset Quality Owner.

  • You can now deactivate users to temporarily suspend their access and reactivate them later.

July 19, 2022

China North 2 (Beijing)

Add, configure, and manage Dataphin members

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Data integration

  • Pipeline tasks now support using physical tables in a project as source or target tables.

  • You can now clone pipeline tasks.

July 19, 2022

China North 2 (Beijing)

Configure a single offline pipeline

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Data modeling

  • Introduces version management for logical tables. You can now view modification history and compare versions.

  • Adds smoke testing for logical tables to verify that they run successfully during development.

  • Introduces Compound Metrics, which allow you to create new metrics by performing calculations on existing Derived Metrics.

  • Logical tables now support configuring data timeliness at the hourly and minute levels.

  • When registering metrics for a summary logical table, you are no longer required to be the owner of the source table. You can now register metrics from any physical table field for which you have read permissions.

July 19, 2022

China North 2 (Beijing)

Overview of data modeling

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Batch development

Introduces a Recycle Bin to restore deleted data processing tasks.

July 19, 2022

China North 2 (Beijing)

Manage objects in the Recycle Bin

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Real-time development

Real-time Development now supports the Ververica Flink engine.

  • Supported data sources: MaxCompute, PolarDB-X, AnalyticDB for MySQL 3.0, Log Service, Aliyun HBase, DataHub, Kafka, Tablestore, RocketMQ, Elasticsearch, and Redis.

  • Supports Flink SQL stream and batch tasks.

  • Supports meta tables and mirrored tables.

  • Supports pre-compilation, debugging, testing, and O&M.

  • Supports coarse-grained resource configuration.

July 19, 2022

China North 2 (Beijing)

Create a Flink SQL task, Create a meta table, Create a mirrored table

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Release center

  • Introduces a publishing validation step where each object is validated against rules in the corresponding change control policy. If an object fails validation, the publishing process is either blocked or a warning is issued.

  • For failed publishing tasks, you can now view deployment logs and use the one-click republish feature.

  • Adds support for viewing version commit history.

July 19, 2022

China North 2 (Beijing)

Overview of release center

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

O&M center

  • You can now perform O&M operations such as data backfilling and reruns for logical tables scheduled at hourly and minute intervals.

  • You can now backfill data for a single metric independently.

July 19, 2022

China North 2 (Beijing)

Overview

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Data catalog

  • Improved the user experience of the data catalog.

  • Introduces a new asset object: Metric.

  • The Asset Details page now includes two new features: View Permission List and Usage Instructions.

July 19, 2022

China North 2 (Beijing)

Data catalog

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Asset permissions

  • You now receive internal messages and email notifications when permissions are about to expire, have expired, are granted, or are revoked.

  • You can now view table permission request records for your account. Administrators can view all table permission operation records.

  • Adds support for batch granting and revoking table permissions.

  • You can now request permissions for physical views and logical views.

  • You can now batch grant permissions for real-time meta tables, including meta tables and mirrored tables used in real-time computing.

July 19, 2022

China North 2 (Beijing)

Data asset permission list

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Asset security

  • The permission system for the security module is optimized.

    • The Security Administrator role can now access the security module in Assets to manage security rules, including creating and editing them.

    • Other users have read-only access to the security module, allowing them to view sensitivity rules and identified sensitive fields.

  • Introduces Project Security Policies for unified management and auditing. This feature also supports automatic installation of security algorithm packages and allows you to view the algorithm installation log.

  • The custom data masking algorithm is enhanced with new options for custom replacement values and regular expressions.

  • You can now transfer recognition rules to other Security Administrators.

July 19, 2022

China North 2 (Beijing)

Overview of asset security

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Asset governance

Logical table governance tasks now include 'Go to O&M' and 'Go to Development' shortcuts to help you quickly confirm and manage them.

July 19, 2022

China North 2 (Beijing)

Governance overview

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Management center

  • Introduces the Publishing Control feature. You can define change validation rules based on metadata such as task name, project, publisher, and publishing time by using a visual form or custom SQL.

  • You can now define change control policies. These policies use your validation rules to set a validation time range and scope. For publishing requests that fail validation, you can configure the system to either block the process or issue a warning.

July 19, 2022

China North 2 (Beijing)

Overview of management center

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

Notification center

Improved the user experience for the Task Center and Message Center.

July 19, 2022

China North 2 (Beijing)

July 21, 2022

China East 1 (Hangzhou)

July 26, 2022

China South 1 (Shenzhen)

August 2, 2022

China East 2 (Shanghai)

May 2022

Feature name

Feature description

Release date

Release region

Related documents

Data source: Support for new types, versions, and parameter optimization

Support for MySQL Data Source version 5.1.43 is now available. This allows you to add a data source that matches your database version.

May 26, 2022

China (Hangzhou)

Create a MySQL data source

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Support for ApsaraDB for ClickHouse data sources is now available. You can now import business data from ApsaraDB for ClickHouse into Dataphin or export data from Dataphin to ApsaraDB for ClickHouse.

May 26, 2022

China (Hangzhou)

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

HBase Data Source now supports namespace configuration.

May 26, 2022

China (Hangzhou)

Create an HBase data source

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Data integration: Enhanced reader and writer capabilities

The LogicalTable Reader component now supports selecting tagged Logical Tables.

May 26, 2022

China (Hangzhou)

Configure a LogicalTable reader

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

The FTP Writer component now lets you merge output files and export Column headers. It also supports configuring a completion marker file for more flexible export workflows.

May 26, 2022

China (Hangzhou)

Configure an FTP writer

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

The MaxCompute Writer component now handles source Columns that contain null values when the target column types are TINYINT, SMALLINT, or INT. This reduces data cleansing costs and increases configuration flexibility.

May 26, 2022

China (Hangzhou)

Configure a MaxCompute writer

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

The optimized one-click table creation feature now automatically populates the output table name and displays input Column comments for reference, which reduces configuration effort.

May 26, 2022

China (Hangzhou)

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Data development: SQL enhancement, new function, and task templates

You can now use the EXPLAIN SQL enhancement to analyze query statements or table structures and identify performance bottlenecks.

May 26, 2022

China (Hangzhou)

SQL enhancement

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

The MAX_PT function now supports using Dataphin project names directly.

May 26, 2022

China (Hangzhou)

Functions

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Adds support for ROW FORMAT SERDE and TBLPROPERTIES syntax.

May 26, 2022

China (Hangzhou)

DDL statements

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Adds support for MSCK REPAIR TABLE and DELETE WHERE syntax.

May 26, 2022

China (Hangzhou)

DML operations

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Support for SHOW FUNCTIONS and LISTFUNCTIONS syntax is now available.

May 26, 2022

China (Hangzhou)

Functions

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Adds support for DESC EXTENDED syntax.

May 26, 2022

China (Hangzhou)

DDL statements

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

You can now create code templates for Shell and Python Tasks. This allows you to develop multiple Tasks from the same template, significantly improving development efficiency.

May 26, 2022

China (Hangzhou)

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Ad hoc query: Automatic termination of long-running tasks

The system now automatically terminates Tasks that run for more than 24 hours to prevent excessive consumption of computing resources.

May 26, 2022

China (Hangzhou)

Query and download data

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Standardized modeling: Enhanced dimension association

Fact Logical Tables now support associating a single Column with multiple Dimension Logical Tables.

May 26, 2022

China (Hangzhou)

Create and configure a Fact Logical Table

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Data distilling: Enhancements to the welcome page, ID Center, Platform Management, and Label Center

The fully upgraded welcome page now includes Platform Management and an ID Center. The feature now supports rule-based statistical tags and registered tags. The enhanced Label Center allows you to manage preference tags.

May 26, 2022

China (Hangzhou)

Overview

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Operation center: New O&M operations, mass data backfill, and minute-level backfilling

Logical Table Instances now support new operations: Forced Rerun, Ignore Upstream Dependencies, and Set to Success and Continue Scheduling. These features support ad-hoc O&M Tasks and improve flexibility.

May 26, 2022

China (Hangzhou)

O&M operations for Logical Table instances

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

This update optimizes the batch operation experience for Logical Table Instance and Backfill Instance lists. The page selection limit is removed, and the backend now determines operability based on Column run status. This update adds support for rerunning all failed Columns, rerunning all final-state Columns, and forcing a rerun of all Columns. For Logical Tables that cannot be rerun after a model refresh, you can now perform a one-click batch Data Backfill to update historical data, which significantly reduces O&M costs.

May 26, 2022

China (Hangzhou)

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

This update introduces a mass Data Backfill feature for handling large volumes of Tasks, which improves O&M efficiency.

May 26, 2022

China (Hangzhou)

Backfill data

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

This update introduces one-click operations to rerun an entire backfill instance, or to rerun or stop all instances for a specific business date within a single backfill Task. This reduces the effort required for batch operations.

May 26, 2022

China (Hangzhou)

Backfill instances

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Hourly and minute-level periodic Tasks now support minute-level Data Backfill.

May 26, 2022

China (Hangzhou)

Backfill data

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

When rerunning Descendant Nodes, the node list can now display all levels (up to 2,000 nodes) to improve the O&M experience.

May 26, 2022

China (Hangzhou)

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

You can now perform a Forced Rerun of Descendant Nodes. This feature ensures full-chain data updates and resolves issues like broken data links or data inconsistencies caused by run status conflicts during a standard rerun.

May 26, 2022

China (Hangzhou)

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

For instances with run-failure monitoring configured, we have updated the alert policy. An alert is now triggered only if the final automatic retry fails, instead of every time a run fails. This reduces unnecessary alert notifications.

May 26, 2022

China (Hangzhou)

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Data security: Custom scheduling for identification rules

Identification rule Tasks now support custom scheduling configurations to modify the scan frequency. You can also configure run-date blocklists for these Tasks to ensure the stability of other Tasks during specific periods.

May 26, 2022

China (Hangzhou)

Create, configure, and manually trigger an identification rule

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Data governance: Metadata Registration feature enhancement

The Metadata Registration feature has been upgraded and renamed to Governance Item Management.

May 26, 2022

China (Hangzhou)

Manage metadata

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

Data service: Enhanced permission capabilities

This update introduces Service Projects. A Service Project is the basic organizational unit for Data Service and acts as the primary boundary for multi-user isolation and access control. You must now use Data Service through a Service Project.

May 26, 2022

China (Hangzhou)

Data Service overview

May 24, 2022

China (Shanghai)

May 19, 2022

China (Shenzhen)

May 17, 2022

China (Beijing)

March 2022

Feature

Description

Date

Region

Documents

Integration with Platform for AI (PAI): Unified Scheduling for PAI Designer Workflows

You can now run Designer Workflows built in Platform for AI (PAI) and schedule them for production based on your node configurations.

March 3, 2022

China (Shanghai), China (Beijing)

March 8, 2022

China (Shenzhen), China (Hangzhou)