Configure a DTS checkpoint node

更新时间:
复制 MD 格式

A Data Transmission Service (DTS) checkpoint node checks whether a target DTS task has synchronized all data generated before a specific point in time. You can add a DTS checkpoint node to a data warehouse development task flow to check the execution status of a DTS task. This check helps you determine whether to run subsequent nodes in the task flow. This topic describes how to configure a DTS checkpoint node.

Prerequisites

A task flow for data warehouse development must be created. For more information, see Create a task flow for data warehouse development.

Terms

  • DTS task: A real-time sync task or a real-time migration task in a data ingestion solution for a project.

    Note

    Real-time sync tasks and real-time migration tasks are built on Data Transmission Service (DTS). They support schema synchronization, full synchronization, and incremental synchronization, including long-term incremental synchronization.

  • DTS checkpoint: A mechanism used to check the status of a DTS task. When a DTS task reaches a checkpoint, it indicates that all database operations that occurred before that point in time have been synchronized.

Procedure

  1. Log in to DMS 5.0.

  2. In the top navigation bar, choose Data+AI > Data Development > Data Warehouse Development.

    Note

    If you use the DMS console in simple mode, move the pointer over the 2023-01-28_15-57-17.png icon in the upper-left corner and choose All Features > Data+AI > Data Development > Data Warehouse Development.

  3. Navigate to the task flow.

    1. In the Project section, click the name of the target project.

    2. Optional: In the navigation pane on the left, click the 5展开3 icon next to the target business scenario to expand the task flows in the scenario.

    3. Double-click the target task flow.

  4. Click the image.png icon to expand the collapsed task flow configuration panel.

    Note

    You can also click the image.png icon to collapse the task flow configuration panel.

  5. Optional: From the Task Type list on the left side of the canvas, drag the DTS Checkpoint node onto the canvas.

  6. Double-click the DTS Checkpoint node.

  7. On the configuration page of the DTS Checkpoint node, select the DTS task to check.

    You can add a DTS task in a data ingestion solution for a project. For more information, see Data ingestion solutions.

  8. Set the time offset from the business time (bizdate). The business time is the day before the task flow is scheduled to run.

    Click Preview to check whether the time point is correct. For example, if you set the time offset to +30 minutes and the workflow execution time is 2022-01-24 14:00, the node checks for a successfully executed DTS task at or after 2022-01-23 14:30. If a successful task is found, this node completes successfully.

  9. Click Test Run.

    • If the last line of the log is status SUCCEEDED, the test run was successful.

    • If the last line of the log is status FAILED, the test run failed.

      Note

      If the test run fails, you can check the log to identify the failed node and determine the cause of the failure.