Manage a data transformation job (new version)

更新时间:
复制 MD 格式

View, start, stop, modify, rerun, and delete a data transformation job (new version) in the Simple Log Service console.

View the details of a data transformation job

  1. Log on to the Simple Log Service console.

  2. In the Projects section, click the one you want.

    image

  3. In the left-side navigation pane, choose Job Management > Data Transformation.

  4. In the list of data transformation jobs, find and click the data transformation job that you want to manage.

  5. On the Data Transformation Overview (New Version) page, view the job details.

    Parameter

    Description

    Display Name

    The display name of the job.

    Task Name

    The unique name of the job within the project.

    Job ID

    The ID of the job.

    Source Logstore

    The source Logstore from which data is read.

    Job Status

    The current job status. ETL.

    Job Created At

    The time when the job was created.

    Job Modified At

    The time when the job was last modified.

    Time range for data transformation (data receiving time)

    The time range during which the job runs.

    Storage Destination

    The destinations for transformed data, including the destination name, target project, target Logstore, and the result set for each destination.

View the status of a data transformation job

You can view the status of a job on the Data Transformation Overview (New Version) page. The lifecycle and status of a job depend on its configuration and the operations you perform. Job statuses and lifecycles. The final states and restart behaviors are as follows:

  • If no end time (data receiving time) is configured, the running instances continuously consume data and the job remains in the Running state.

  • If an end time (data receiving time) is configured, all instances stop after processing data within the specified range. The job status then changes to Successful..

  • If a job is Stopped or enters an error state (for example, due to an invalid Structured Process Language (SPL) statement), it resumes from the last saved checkpoint when restarted.

Stop a data transformation job

For a job that is in the Running state, on the Data Transformation Overview (New Version) page, choose Actions > Stop.

Important

When stopped, the system records the current checkpoint. Restarting the job resumes transformation from this checkpoint. To restart from the beginning, rerun the job. Rerun a data transformation job.

Start a data transformation job

For a job that is in the Stopped state, on the Data Transformation Overview (New Version) page, click Start.

Modify the transformation rule

Important

After you modify a job, restart it for the new configurations to take effect.

  1. On the Data Transformation Overview (New Version) page, click Edit Rule.

  2. Modify the transformation rule based on your business requirements.

    For rule syntax details, see SPL instructions.

  3. Preview data.

    • On the Raw Data tab, click Add Test Data. You can also manually enter test data on the Test Data tab.

  4. Click Modify Transformation Settings.

  5. Modify the settings, and then click OK.

    For parameter descriptions, see Create a data transformation job.

Delete a data transformation job

Warning

Deleted jobs cannot be restored. Proceed with caution.

You can delete a job by using either of the following methods:

  • In the data transformation job list, find the target job and choose More > Delete in the Actions column.

  • On the Data Transformation Overview(New Version) page, choose Actions > Delete.

Rerun a data transformation job

You can rerun a job regardless of its current status. On the Data Transformation Overview (New Version) page, choose Actions > Re-run.

Important

Rerunning a job starts transformation from the beginning, not from the last checkpoint.