Real-time mode dependency configuration

更新时间:
复制 MD 格式

Configure dependencies for real-time tasks to quickly identify upstream and downstream tasks during debugging.

Procedure

  1. Refer to real-time mode configuration entry to access the Real-time Mode configuration page for real-time tasks.

  2. In the Dependency section of the configuration panel, configure dependency details for real-time mode tasks.

    Important
    • Dependencies in real-time mode do not create actual scheduling dependencies.

    • In offline mode, you must configure scheduling dependencies.

    image

    Parameter

    Description

    Start Parsing

    For SQL node tasks, click Start Parsing to parse the code. The system identifies tables in the code and matches them with output names to determine upstream dependencies of the current node.

    If project variables are referenced or no project is specified, the system uses the production project name for parsing to ensure schedule stability. For example, with a development project named onedata_dev:

    • Code select * from s_order results in a dependency of onedata.s_order.

    • Code select * from ${onedata}.s_order also results in a dependency of onedata.s_order.

    • Code select * from onedata.s_order results in a dependency of onedata.s_order.

    • Code select * from onedata_dev.s_order results in a dependency of onedata_dev.s_order.

    Upstream Dependency

    To add upstream nodes for task scheduling:

    1. Click Manually Add Upstream.

    2. In the Create New Upstream Dependency dialog box, search for dependency nodes using either method:

      • Enter the output name of the dependent node as the search keyword.

      • Type virtual to find virtual nodes. Each tenant or enterprise has a root node assigned upon initialization.

      Note

      Node output names are globally unique and case-insensitive.

    3. Click Confirm Addition.

    To delete a dependency, click the fagaga icon in the Actions column.

    Current Node

    To set output names that other nodes can use as dependencies:

    1. Click Manually Add Output.

    2. In the Add Current Node Output dialog box, enter the output name following a consistent naming convention, such as project name.table name, which is case-insensitive.

      For example, for a development project named onedata_dev, the recommended output name is onedata.s_order. Setting the output name to onedata_dev.s_order will only allow code referencing onedata_dev.s_order to parse the upstream dependency node.

    3. Click Confirm Addition.

    You can also manage existing output names for the current node:

    • To delete added output names, click the Actions column's fagaga icon.

    • If the node is already submitted or published and has downstream dependencies (with submitted tasks), click the Actions column's icon to see the dependent nodes.

  3. Click Confirm to save the dependency configuration.