Create a Shell task

Procedure

1. In the top navigation bar of the Dataphin homepage, choose Development > Data Development.

2. On the Development page, select a Project. In Dev-Prod mode, also select an environment.

3. In the navigation pane on the left, choose Data Processing > Compute Task. In the Compute Task list, click the icon and select Shell.

4. In the Create Shell Task dialog box, configure the following parameters.

   Parameter	Description
   Task name	Enter the task name. Maximum 256 characters. The following characters are not allowed: | / \ : ? <> * "
   Scheduling type	Select a scheduling type. Options: Periodic Task: Runs automatically on a schedule. Manual Task: Runs only when triggered manually.
   Select directory	Select the folder to store the task. To create a new folder: Above the task list, click the icon to open the Create Folder dialog box. In the Create Folder dialog box, enter a Name and optionally select a directory. Click OK.
   Use template	Turn on Use Template to apply a code template, then select a template and template version. Template code is read-only — configure only the parameters. Create an offline computing template.
   Python third-party package	Select Python third-party packages. Install a Python module. Note After adding a module, declare it in the task before importing it in your code. Configure referenced modules in the task's Python third-party package properties.
   Description	Enter a task description. Maximum 1,000 characters.

5. Click OK.

6. In the code editor, write your Shell script. Click Run in the toolbar to execute it.

7. In the right-side pane, click Properties. In the Properties panel, configure General, Runtime resources, Python third-party package, Dataset, Runtime parameters, Scheduling properties, Scheduling dependencies, Runtime configurations, and Resource configurations.

   • General

     Basic task information: name, owner, and description. Configure general information for a task.

   • Runtime resources

     CPU and memory for the task. Defaults to 0.1 core and 256 MB. Configure runtime resources for an offline task.

   • Python third-party package

     Select Python packages to include. Install a Python module.

   • Dataset

     Select up to 5 datasets to reference. .

   • Runtime parameters

     Assign values to parameter variables in your task code. During scheduled runs, variables are replaced with assigned values. Configure runtime parameters for an offline task.

   • Scheduling properties (for periodic tasks)

     Required for Periodic Task scheduling type. Configure in addition to Basic Information. Configure scheduling properties for offline tasks.

   • Scheduling dependencies (for periodic tasks)

     Required for Periodic Task scheduling type. Configure in addition to Basic Information. Configure offline task scheduling dependencies.

   • Runtime configurations

     Task-level settings such as timeout and retry policy. Inherits tenant defaults if not configured. Configure runtime settings for a compute task.

   • Resource configurations

     Assign a scheduling resource group. The task consumes the group's resource quota during scheduling. Configure resources for a compute task.

8. On the Shell task tab, save and submit the task.

   1. In the toolbar, click the icon to save.

   2. Click the icon to submit.

9. On the Submission Details page, review the Content to Submit and pre-check results, then enter any remarks. Submission instructions for offline compute tasks.

10. Click OK and Submit.