Create a labeling job

更新时间:
复制 MD 格式

Create annotation jobs using preset templates for image, text, video, and audio data, or build custom templates for specific scenarios.

Prerequisites

Before you begin, ensure that you have:

How it works

Creating a labeling job in iTAG follows this sequence:

  1. Select a dataset — Choose the OSS-backed dataset to annotate.

  2. Choose a template — Pick a preset template (image, text, video, or audio) or build a custom template.

  3. Configure labels — Define tag names and set single or multiple tag selection per object.

  4. Set up the workflow — Assign subtask packages, configure the check proportion, and assign labelers and reviewers.

  5. Publish — Click Create to publish the job. Labelers can then claim subtask packages from the Task Center.

Create a labeling job

  1. Log on to the PAI console.

  2. In the left-side navigation pane, click Workspaces. On the Workspaces page, click the name of the workspace you want to manage.

  3. In the left-side navigation pane, choose Data Preparation > iTAG.

  4. On the iTAG page, go to the Jobs tab and click Create Task.

  5. On the Create Labeling Job page, configure the basic settings:

    ParameterDescription
    Task Name1–100 characters. Must start with a letter, digit, or Chinese character. Can include underscores (_) or hyphens (-).
    Input DatasetSelect a dataset from PAI dataset management.
    Task DescriptionA brief description to distinguish this job from others.
  6. Select a template type and template.

    • General Template: Use a preset platform template. Select one of the following:

      CategoryTemplateDescription
      ImageOCRRecognize text within a selected image area.
      Object DetectionDetect and locate objects in images.
      Image ClassificationClassify images with preset tags.
      PDFPerform OCR and classification on PDF files.
      Moderation and MattingModerate and perform matting on images.
      Table RecognitionPre-recognize core table elements. Edit results as needed.
      TextEntity RecognitionRecognize named entities in text.
      Text ClassificationClassify text with preset tags. Supports single-tag and multi-tag classification.
      Entity relationshipIdentify relationships between text entities for knowledge graph scenarios.
      VideoVideo ClassificationClassify videos with preset tags. Supports single-tag and multi-tag classification.
      AudioAudio ClassificationClassify audio files with preset tags. Supports single-tag and multi-tag classification.
      Audio segmentationSegment audio content and add tags to each segment.
      Audio RecognitionRecognize and transcribe text from audio content.

      For application scenarios and data formats, see Image, Text, Video, and Audio.

    • Custom Template: See Labeling templates.

    • Custom Template: Build a template for a specific scenario by combining Content Components and Topic Components as prompted. For input and output data formats, see Custom templates.

  7. (Conditional) If you selected Image > OCR, configure OCR recognition results configuration. The default value is OCR Recognition Results, which performs OCR on text within selected image areas.

  8. Configure label settings under Label Configuration:

    • Enter tag names one at a time, pressing Enter after each name. For example, to label cats in images, add tags such as "Cat", "American Shorthair", and "British Shorthair".

    • Set the tag selection mode:

      • Single Choice: Each labeler applies one tag per selected object.

      • Multiple Choice: Each labeler applies multiple tags per selected object. For example, a labeler can select a cat and apply both "Cat" and "American Shorthair".

    Single Choice and Multiple Choice control the number of tags applied to a single selected object, not the total number of selections per data sample.
  9. (Optional) Enable intelligent pre-labeling under Enable Intelligent Labeling. See Data pre-labeling: Intelligent labeling configurations.

  10. Configure subtask package allocation under Assign Subtask Packages. iTAG groups annotation tasks into subtask packages. Labelers claim packages and process all tasks within them. Choose one of the following allocation rules:

    RuleDescription
    Fixed sizeAssigns a fixed number of tasks per package. The allowed range depends on dataset size: 1–200 for datasets up to 20,000 records, 5–200 for 20,000–100,000 records, 25–200 for 100,000–500,000 records, and 50–200 for 500,000–1,000,000 records.
    Press Import FieldsGroups data by a selected dataset field. Records with the same field value go into the same package.
    Targeted AssignmentAssigns packages directly to specific labelers or teams.
  11. (Conditional) If your Task Workflow includes a check step — such as Marking-Check or Marking-Inspection-Acceptance — set the sampling ratio under Check Proportion. The default is 100%.

  12. Under User Configuration, assign labelers, checkers, accepters, or task administrators (individuals or groups) based on the selected Task Workflow. For role permissions in iTAG, see iTAG overview.

  13. Click Create.

View and manage labeling jobs

After creating a job, view all jobs on the Task Center page in iTAG. Check status and use the Actions column to manage jobs.

image
AreaTaskDescription
Process annotation tasksClick Go to the iTAG Page to access the annotation interface. Claim and process annotation, check, and acceptance tasks. See Process labeling tasks.
View job statusView the status of all labeling jobs on the Task Center page.
Manage subtask packagesFor incomplete jobs, click Subtask Details to review subtask package completion. For incomplete packages, click Transfer to reassign to another labeler, or Release to make the package available for others to claim.
Export resultsFor completed jobs, click Export Labeling Result to export results. Click Obtain Data Record to check retrieval progress. See Export labeling result data.
More operationsClick image in the Actions column to publish or unpublish a job.

What's next

Claim and process annotation tasks. See Process labeling tasks.