Configure data delay for a logical table

Limitations

• You can enable data delay only when the current tenant's offline engine is MaxCompute, E-MapReduce 3.x, E-MapReduce 5.x, CDH 5.X, CDH 6.X, Cloudera Data Platform, FusionInsight 8.X, Asiainfo DP 5.3, or Amazon EMR, the fact logical table is processed daily (T+1 offline), and the logical table has an event time field.

• You cannot enable data delay if the logical table does not have an event time field or a primary key.

• You cannot enable both data delay and customized materialization for the same logical table.

• In single-tenant, multi-engine mode, you can configure data delay only when the logical table's data block uses a MaxCompute or Hadoop (CDH 5.x, CDH 6.x, Cloudera Data Platform 7.x, E-MapReduce 3.x, E-MapReduce 5.x, Asiainfo DP 5.3, or FusionInsight 8.x) offline engine.

Procedure

1. On the Dataphin homepage, go to Development > Data Development in the top navigation bar.

2. On the Data Development page, select a project from the top navigation bar. In Dev-Prod mode, you must also select an environment.

3. In the navigation pane on the left, choose Standardized Modeling > Dimension Logical Table or Fact Logical Table. Then, in the logical table directory tree on the right, select the logical table.

4. On the logical table's tab, click Scheduling Configuration to open the Scheduling Configuration panel.

5. In the Scheduling Configuration panel, enable Data Delay for the logical table. Once enabled, the system automatically reruns all data for the table within the time window specified by Maximum Delay Days (1 to 15 days). This feature consumes additional computing resources and may increase output latency.

   Note

   • You cannot enable data delay if the logical table does not have an event time field or a primary key, or if customized materialization is already enabled.

   • This feature reruns only the specified logical table within the configured period and does not automatically rerun its downstream dependencies.

   • If you delete the primary key from a logical table after enabling data delay, the system automatically disables the feature.

6. Click OK.

Next steps

After configuring data delay for the logical table, configure its scheduling properties. For more information, see Configure scheduling properties for a logical table.