Audio enhancement
The Audio Enhancement operator processes audio for denoising, volume normalization, echo cancellation, and signal enhancement. This improves audio quality and increases the recognition rate of subsequent algorithms. The operator processes only audio objects in the input dataset and automatically ignores non-audio objects. This topic describes how to configure the Audio Enhancement operator.
Prerequisites
The workflow feature is available only after you purchase the unstructured data feature for the current instance.
A workflow is created. For more information, see Create a workflow.
Background information
The Audio Enhancement operator supports the following file formats: aac, amr, avi, flac, flv, m4a, mkv, mov, mp3, mp4, mpeg, ogg, opus, wav, webm, wma, and wmv.
The Audio Enhancement operator is allocated 1 core and 2 GB of resources by default.
Permissions
Project administrators, developers, analysts of a Basic project, and custom project roles with the Dataset-Use permission can use all datasets in the project for the input and output datasets of the operator.
Procedure
On the Dataphin home page, choose R&D > Data R&D from the top menu bar.
On the Developer page, select Project from the top menu bar.
In the navigation pane on the left, choose Data Processing > Workflow. In the Workflow list on the left, click the destination workflow to open the workflow canvas. From the Operator Library on the left, drag the Audio Enhancement operator to the canvas. Then, in the Audio Enhancement panel on the right, configure the following parameters.
Parameter
Description
Step Name
Enter a name for the operator. The name can contain any characters and be up to 256 characters in length.
Input Configuration
Dataset
Select the dataset to process. You can select only a Hybrid Dataset. After you select a dataset, select a Version. The default version is the first version of the dataset.
If this operator is a downstream operator, the selected dataset is usually the same as the output dataset of the upstream operator.
Input Field
The storage URL of the audio file to process. Select a source field from the input dataset. You can select only a field for which the Is URL parameter is set to Yes.
Filter Condition (Optional)
Use SQL syntax. Enter only the filter condition that follows the WHERE clause. You can use system global variables, such as the data timestamp ${bizdate}.
Output Configuration
Dataset
You can select Source Dataset or Other Dataset. If the metadata table of the source dataset does not have a primary key, Other Dataset is selected by default for the output dataset.
If you select Other Dataset, you must also specify a Hybrid Dataset and its Version as the output dataset. The default version is the first version of the dataset. You can also select other versions of the source dataset.
If you select Source Dataset, the metadata generated by the operator is written to the metadata table that corresponds to the same version of the source dataset.
File Output Path
Enter the storage subdirectory for the transcoded files.
Loading Policy
If the metadata table of the selected output dataset has a primary key, Update on Primary Key Conflict is selected by default. If no primary key exists, Append Data is selected by default.
Append Data: Appends data directly to the destination table. If a primary key or constraint violation occurs, an error is reported.
Update on Primary Key Conflict: If a primary key or constraint violation occurs, the old data in the entire row with the duplicate primary key is deleted before the new data is inserted.
Overwrite: Deletes the data from the destination table before writing the new data.
NoteIf you select Source Dataset for the output dataset, only Update on Primary Key Conflict is supported as the loading policy.
Field Mapping
The Audio Enhancement operator has the following fixed output field:
enhanced_audio_url: The storage URL of the enhanced audio.By default, the operator's output fields are mapped to the fields with the same names in the output dataset. You can also manually select destination fields for custom mapping. In addition, you can map the pass-through fields of the source dataset to the destination dataset. You can manage field mappings in the following ways:
Add Output Field: Click to add a blank row for field mapping. This feature is supported only when you select Other Dataset for the output dataset.
Batch Mapping: Click to choose between batch manual mapping, same-name mapping, or same-row mapping. This feature is supported only when you select Other Dataset for the output dataset.
Delete Mapping: Click the Delete icon to delete the field mapping for the corresponding row. You cannot delete the mapping for the operator's fixed output field.
After you complete the configuration, click Save in the menu bar at the top of the canvas to save the configuration.
After you configure a single operator, you can select upstream or downstream operators to complete the workflow configuration.