Create a MapReduce on Yarn task

Procedure

1. On the Dataphin home page, select Development > Data Development from the top menu bar.

2. On the Development page, choose Project from the top menu bar (Dev-Prod mode requires environment selection).

3. In the navigation pane on the left, select Data Processing > Compute Task. In the Compute Task list, click the icon and select MapReduce on Yarn.

4. In the Create MapReduce on Yarn Task dialog box, configure the following parameters.

   Parameter	Description
   Task Name	Enter the offline computing task name. The length must not exceed 256 characters and should not include vertical lines (|), forward slashes (/), backslashes (\), colons (:), question marks (?), angle brackets (<>), asterisks (*), or quotation marks (").
   Schedule Type	Select a schedule type: Recurring Task: Automatically included in the system's periodic scheduling. One-Time Task: Must be manually triggered to run.
   Select Directory	Select the folder where the task is located. If no directory exists, you can Create Folder using the following steps: Click the icon above the task list to open the Create Folder dialog box. In the Create Folder dialog box, provide the folder Name and, if desired, choose a Select Directory location. Click Confirm.
   Use Template	Toggle the Use Template switch to use a code template. If enabled, you must also Select Template and specify the Template Version. Code templates are read-only. Configure the required template parameters to complete development. For more information, see the referenced document.
   Description	Provide a brief description of the task, within 1000 characters.

5. Click Confirm.

6. In the code editor on the MapReduce on Yarn task tab, write the code for the MapReduce on Yarn offline computing task. When you are finished, click Run.

7. In the right-side sidebar, click Property. In the Property panel, configure the task properties, such as Basic Information, Running Resources, Runtime Parameter, Scheduling Properties (for recurring tasks), Schedule Dependency (for recurring tasks), Runtime Configuration, and Resource Configuration.

   • Basic Information

     Define the task name, owner, description, and other basic scheduling information. For configuration instructions, see the referenced document.

   • Running Resources

     Defaults to 0.2 cores and 512MB. For configuration instructions, see the referenced document.

   • Parameter Settings

     Set values for parameter variables used in the task. During scheduling, these variables are automatically replaced with their assigned values. For configuration guidance, see the referenced document.

   • Scheduling Properties (for recurring tasks)

     Required for Recurring Task types. Configure scheduling frequency and time settings in addition to Basic Information. For configuration instructions, see the referenced document.

   • Schedule Dependency (for recurring tasks)

     Required for Recurring Task types. Configure upstream and downstream task dependencies in addition to Basic Information. For configuration instructions, see the referenced document.

   • Runtime Configuration

     Configure task-level timeout and rerun policies. If not configured, tenant-level defaults are inherited. For configuration instructions, see the referenced document.

   • Resource Configuration

     Assign a resource group for the task. The task uses the resource quota of this group at scheduling time. For more information, see Resource configuration for computing tasks.

8. On the MapReduce on Yarn task tab, save and submit the task.

   1. Click the icon to save the code.

   2. Click the icon to submit the code.

9. On the Submit Details page, confirm the Submission Content and Pre-check results, and enter notes. For more information, see Offline Computing Task Submission Instructions.

10. After reviewing, click Confirm And Submit to proceed.