DocsICP FilingConsole
Documentation
Home Page Dataphin Dataphin(Non-shared) User Guide Data Development Encoding research and development Workflow Operator library Audio operator Audio synthesis detection

Audio synthesis detection

Updated at:
Copy as MD
Product
My Favorites

The audio synthesis detection operator detects AI-synthesized speech in an audio file and returns a probability value from 0.0 to 1.0. You can use this operator to filter synthesized audio and ensure data quality. This topic describes how to configure the audio synthesis detection operator.

Prerequisites

  • The workflow feature is available only after you purchase the unstructured data feature for your instance.

  • You have created a workflow. For more information, see Create a workflow.

Background information

  • The audio synthesis detection operator supports files in the following formats: aac, amr, avi, flac, flv, m4a, mkv, mov, mp3, mp4, mpeg, ogg, opus, wav, webm, wma, and wmv.

  • The audio synthesis detection operator is allocated 1 Core and 2 GB of resources by default.

Permissions

In a Basic project, project administrators, developers, and analysts can use any dataset within the project as an input or output for the operator. Custom project roles with the Dataset - Use permission can also do this.

Procedure

  1. In the top menu bar of the Dataphin home page, select Development > Data Development.

  2. On the top menu bar of the Developer page, select Project.

  3. In the navigation pane on the left, select Data Processing > Workflow. In the Workflow list, click the target workflow to open the workflow canvas. Drag the Audio Synthesis Detection operator from the Operator Library on the left to the canvas. In the Audio Synthesis Detection panel on the right, configure the following parameters.

    Parameter

    Description

    Step Name

    Enter a name for the operator. The name can contain any characters and be up to 256 characters in length.

    Input Configuration

    Dataset

    Select the dataset to process. You can select only a Hybrid Dataset. After you select a dataset, select a Version. The default version is the first version of the dataset.

    If this operator is a downstream operator, the selected dataset is typically the same as the output dataset of the upstream operator.

    Input Field

    The storage URL of the audio file to be processed. Select a source field from the input dataset. You can select only fields for which the Is URL parameter is set to Yes.

    Filter Condition (Optional)

    Use SQL syntax. Enter only the filter condition that follows the `WHERE` clause. You can use system global variables, such as the data timestamp `${bizdate}`.

    Operator Configuration

    Processing Model

    Select a model for the operator. You can select only models that are enabled and have a model type of Audio in Intelligent Application Management > Model Configuration.

    Output Configuration

    Dataset

    You can select Source Dataset or Other Dataset. If the metadata table of the source dataset does not have a primary key, the output dataset is set to Other Dataset by default.

    • If you select Other Dataset, specify a Hybrid Dataset and its Version as the output dataset. The default version is the first version of the dataset. You can also select other versions of the source dataset.

    • If you select Source Dataset, the metadata generated by the operator is written to the metadata table that corresponds to the same version of the source dataset.

    Loading Policy

    If the metadata table of the selected output dataset has a primary key, Update on Primary Key Conflict is selected by default. If no primary key exists, Append Data is selected by default.

    • Append Data: Appends data directly to the destination table. A fault is reported if a primary key conflict or constraint violation occurs.

    • Update on Primary Key Conflict: If a primary key conflict or constraint violation occurs, the old data in the entire row with the duplicate primary key is deleted before the new data is inserted.

    • Overwrite: Deletes the data in the destination table before writing the new data.

    Note

    If you set the output dataset to Source Dataset, only Update on Primary Key Conflict is supported as the loading policy.

    Field Mapping

    The audio synthesis detection operator always outputs the following field:

    synthetic_probability: The probability that the audio is AI-synthesized (0.0–1.0). A value closer to 1.0 indicates a higher probability of AI synthesis.

    By default, the operator's output field is mapped to the field with the same name in the output dataset. You can also manually select a destination field for a custom mapping. In addition, you can map pass-through fields from the source dataset to the destination dataset. Manage field mappings in the following ways:

    • Add Output Field: Click to add a new, empty field mapping row.

    • Batch Mapping: Click to choose between batch manual mapping, same-name mapping, or same-row mapping.

    • Delete Mapping: Click the Delete icon to delete the field mapping for a row. You cannot delete the mapping for the operator's fixed output field.

  4. After you complete the configuration, click Save in the menu bar at the top of the canvas.

    After you configure the operator, you can add upstream or downstream operators to complete the workflow.

Previous：Timbre transformationNext：Video operator