Guidelines for submitting offline computing nodes
When you develop and submit an offline computing node, Dataphin automatically parses the data lineage of tables and fields in the node. The system also identifies the change type and content of the node object and runs pre-checks on the submitted node. These checks ensure that your node meets submission requirements and reduce the risk of submitting a faulty node.
Lineage Relationship Parsing Description
Data lineage parsing: When you submit a node, the system parses the data lineage in the development environment. When you publish the node, the system parses the data lineage in the production environment. The system can parse up to 100,000 data lineage records. If this limit is exceeded, the records are not saved and cannot be displayed in the Asset folder.
Submission details
When you submit an offline computing node, the Submitting Log dialog box appears. In this dialog box, you can view the submission content and pre-check results for the node, and add submission comments.
Submission content
View the object name, object type, change type, and change content for the submitted node object. The change content includes Basic Information, Compute Code, Runtime Parameters, Scheduling Configuration, Scheduling Dependencies, Runtime Configuration, and .
Pre-checks
When you submit an offline computing node, the system performs the following pre-checks. You cannot submit the node until all check items are configured correctly.
Check Item
Description
Scheduling Dependencies
Dataphin uses the scheduling dependency configurations of each node to run the nodes in a business flow in an orderly manner. This ensures that business data is generated efficiently and on time. For more information, see Configure scheduling dependencies for an offline node.
Runtime Parameters
Runtime parameter settings assign values to the variables used in the node's code to support node scheduling. Parameter variables are automatically replaced with their corresponding values. For more information, see Configure runtime parameters for an offline node.
Cross-node Parameters
Variable parameters that are passed through to the immediate descendant nodes of this node object. For more information, see Configure runtime parameters for an offline node.
Submission comments
Add comments for this submission. Comments can be up to 128 characters long.
Check items
After all pre-checks pass, click OK and Submit. In the Submitting Log dialog box, you can view the check items and results for the node.
Check Item | Description |
Configuration Check | This check includes pre-checks, code length, referenced resource count, and offline code template version.
|
Parameter Settings | The system parses all variables in the code and displays them in a list. The list includes the parameter name, parameter type, and current actual value. The system checks whether local variables are assigned values. |
Syntax Check | For SQL nodes only. The system checks the SQL syntax for correctness. If errors exist, you cannot submit the node. |
Object Check | For SQL nodes only. Checks whether all referenced objects are submitted and published to the production environment. The system parses all referenced objects in the code and displays them in a list. The list includes the object name, object type, and check result.
|
Permission Check | The system parses all objects in the code and displays a list indicating whether you have the required operation permissions for the objects. The list includes the object name, object type, check result, row-level permission status, and permission request operation.
|
Standard Check | For SQL nodes only. The system scans the SQL code based on built-in standards and displays the check result for each standard. For more information, see Coding standards. |
Dependency Check | Checks the dependency configuration and output configuration.
|
Code Review | The system automatically checks whether the node has configurations that trigger a code review. If so, a code review is required. For example, a code review is triggered if the node references a global variable for which code review is enabled. For more information, see View and configure built-in approval templates. Important
|
Operation Execution | When this check is reached, the system executes the submission. You cannot revoke the submission while the operation is in progress. |