Timbre transformation

Prerequisites

• The workflow feature is available only after you purchase the unstructured data feature for your instance.

• A workflow has been created. For more information, see Create a workflow.

Background information

• The timbre transformation operator supports the following file formats: aac, amr, avi, flac, flv, m4a, mkv, mov, mp3, mp4, mpeg, ogg, opus, wav, webm, wma, and wmv.

• The timbre transformation operator is allocated 1 Core and 2 GB of resources by default.

Permissions

In a Basic project, the following roles can use any dataset in the project for the operator's input and output: project administrators, developers, analysts, and custom roles with the Dataset - Use permission.

Procedure

1. On the Dataphin home page, choose Develop > Data Development from the top menu bar.

2. On the Developer page, select Project from the top menu bar.

3. In the navigation pane on the left, choose Data Processing > Workflow. In the Workflow list on the left, click the target workflow to open its canvas. From the Operator Library on the left, drag the Timbre Transformation operator to the canvas. In the Timbre Transformation pane on the right, configure the following parameters.

   Parameter		Description
   Step Name		Enter a name for the operator. The name can contain any characters and be up to 256 characters in length.
   Input Configuration	Dataset	Select a mixed dataset and its version. The first version is selected by default. Version When this operator is a downstream operator, the selected dataset is usually the same as the output dataset of the upstream operator.
   	Input Field	The storage URL of the audio file to process. Select a source field from the input dataset. You can select only fields for which the Is URL parameter is set to Yes.
   	Filter Condition (Optional)	Use SQL syntax. Enter only the filter condition that follows the `WHERE` clause. You can use system global variables, such as the data timestamp `${bizdate}`.
   Output Configuration	Dataset	You can select Source Dataset or Other Dataset. If the metadata table of the source dataset does not have a primary key, Other Dataset is selected by default for the output dataset. If you select Other Dataset, you must also specify a Hybrid Dataset and its Version as the output dataset. The default version is the first version of the dataset in ascending order. You can also select other versions of the source dataset. If you select Source Dataset, the metadata generated by the operator is written to the metadata table that corresponds to the same version of the source dataset.
   	File Output Path	The prefix is the file storage directory for the selected dataset. You can add a subdirectory, but each source video file must be in its own separate subdirectory.
   	Loading Policy	If the metadata table of the selected output dataset has a primary key, Update on Primary Key Conflict is selected by default. If no primary key exists, Append Data is selected by default. Append Data: Directly appends new data to the destination table. If a primary key conflict or constraint violation occurs, an error is reported. Update on Primary Key Conflict: If a primary key conflict or constraint violation occurs, the old data in the row with the duplicate primary key is deleted before the new data is inserted. Overwrite: Deletes the data from the destination table before writing the new data. Note If you select Source Dataset as the output dataset, only the Update on Primary Key Conflict loading policy is supported.
   	Field Mapping	The timbre transformation operator has the following fixed output field: convert_audio_url: The storage URL of the audio after timbre transformation. By default, the operator's output fields are mapped to the fields with the same names in the output dataset. You can also manually select destination fields for custom mapping. You can also map the pass-through fields of the source dataset to the destination dataset. You can manage field mappings in the following ways: Add Output Field: Click to add a new empty field mapping. Batch Mapping: Click to choose between batch manual mapping, mapping by name, or mapping by row. Delete Mapping: Click the Delete icon to delete the field mapping in the corresponding row. You cannot delete the mapping for the operator's fixed output field.

4. After you complete the configuration, click Save in the top menu bar of the canvas.

   After you configure a single operator, you can continue to select upstream or downstream operators to complete the workflow configuration.