Paraformer non-real-time speech recognition HarmonyOS SDK
This guide explains how to use the Paraformer non-real-time speech recognition HarmonyOS SDK to convert speech to text.
User guide: Non-real-time speech recognition
Quick start
-
Obtain an API key: Obtain and configure an API key. For security, we recommend configuring the API key as an environment variable.
NoteTo grant temporary access to third-party applications or users, or to strictly control high-risk operations such as accessing or deleting sensitive data, use a temporary API key. A temporary API key is valid for 60 seconds by default. Obtain a new one after it expires.
-
Download the SDK and run the sample code:
- Download the latest SDK package.
- Extract the TAR package. Obtain the HAR-format SDK from the
neonuidirectory and add it to your project dependencies. For C++ integration, obtain the dynamic libraries and header files fromnative/libsandnative/includein the TAR package. - Open the project in DevEco Studio. The sample code is located in
DashParaformerFileTranscriberPage.ets. Replace the API key to try the feature.
Invocation steps
Synchronous mode
- Initialize the SDK.
- Configure parameters based on your business requirements.
- Call
startFileTranscriberto start a recognition task withasync_requestset tofalse. - In the
onFileTransEventCallbackinterface, listen for theEVENT_FILE_TRANS_RESULTevent to obtain the final recognition result. - Call
releaseto release SDK resources.
Asynchronous mode
- Initialize the SDK.
- Configure parameters based on your business requirements.
- Call
startFileTranscriberto start a recognition task withasync_requestset totrue. - Call
queryFileTranscriberto query the recognition progress or result. - In the
onFileTransEventCallbackinterface, listen for theEVENT_FILE_TRANS_QUERY_RESULTevent to obtain the current query result. - In the
onFileTransEventCallbackinterface, listen for theEVENT_FILE_TRANS_RESULTevent to obtain the final recognition result. - Call
releaseto release SDK resources.
Request parameters
Connection and control parameters
Pass a JSON string to the parameters parameter of initializeFileTrans to configure the following parameters.
Example: The following JSON string is an example and does not include all parameters. Add parameters as needed:
{
"url": "wss://{WorkspaceId}.cn-beijing.maas.aliyuncs.com/api/v1/services/audio/asr/transcription",
"apikey": "st-****",
"device_id": "my_device_id",
"service_mode": "1"
}
- Parameter descriptions
| Parameter | Type | Required | Description |
|---|---|---|---|
url | string | Yes | The endpoint. This is fixed at |
apikey | string | Yes | The API key. We recommend using a more secure temporary API key with a short validity period to reduce the risk of leaking a long-term key. |
service_mode | string | Yes | The operating mode. For non-real-time speech recognition, this is fixed at |
device_id | string | Yes | A unique string that identifies the end user. You can set it to an in-app user ID or a unique device identifier generated by the client. This ID is mainly used for log tracking and troubleshooting. |
debug_path | string | No | The storage path for log files. This parameter takes effect only if you set |
max_log_file_size | number | No | Sets the maximum size of a log file in bytes. This parameter takes effect only if you set |
Speech recognition effect parameters
Configure the nls_config parameter by using setParams, or configure all speech recognition effect parameters by using startFileTranscriber.
Example: The following JSON string is an example and does not include all parameters. Add parameters as needed:
{
"file_urls": [
"{YOUR_AUDIO_URL}"
],
"async_request": false,
"nls_config": {
"model":"paraformer-v2",
"disfluency_removal_enabled":false,
"timestamp_alignment_enabled": false
}
}
- Parameter descriptions
| Parameter | Type | Required | Description |
|---|---|---|---|
file_urls | array[string] | Yes | A list of URLs for the audio or video files to transcribe. HTTP and HTTPS are supported. A single request supports only 1 URL. If an audio file is stored in Alibaba Cloud OSS, the SDK does not support a temporary URL that uses the ImportantBecause audio and video formats have many variants, it is technically impossible to test all of them. The API cannot guarantee that every format can be correctly recognized. Test your file to verify that it produces a valid recognition result. - Audio sample rates vary by model: - paraformer-v2 supports any sample rate. - paraformer-v1 supports any sample rate. - paraformer-8k-v2 supports only 8 kHz. - paraformer-8k-v1 supports only 8 kHz. - paraformer-mtl-v1 supports 16 kHz and higher. - Audio file size and duration: The file cannot exceed 2 GB, and its duration cannot exceed 12 hours. To process a file that exceeds these limits, preprocess it to reduce the file size. For best practices, see Preprocess video files to improve transcription efficiency for audio file recognition. |
async_request | boolean | No | Specifies whether to use an asynchronous request. Default value: |
apikey | string | No | If |
nls_config | object | Yes | The core speech recognition configuration object, which contains key parameters for model selection and recognition effect control. |
nls_config.model | string | Yes | The speech recognition model. |
nls_config.language_hints | array[string] | No | Specifies language codes for the audio to recognize. This parameter applies only to paraformer-v2. Default value: |
nls_config.disfluency_removal_enabled | boolean | No | Specifies whether to remove disfluencies such as filler words. Default value: false. Valid values: - true: removes disfluencies - false: retains disfluencies. |
nls_config.timestamp_alignment_enabled | boolean | No | Specifies whether to enable timestamp alignment. Default value: false. Valid values: - true: enabled - false: disabled. |
nls_config.special_word_filter | object | No | Specifies sensitive words to process during speech recognition and supports different processing methods for different words. If this parameter is omitted, the built-in sensitive-word filtering logic is enabled. Words that match the Alibaba Cloud Model Studio sensitive word list are replaced with the same number of |
nls_config.channel_id | array[integer] | No | Specifies the indexes of audio tracks to recognize in a multitrack audio file. Indexes start from 0. For example, ImportantEach specified track is billed separately. For example, Default value: |
nls_config.diarization_enabled | boolean | No | Specifies whether to enable speaker diarization. This feature is disabled by default. It applies only to mono audio. Multichannel audio does not support speaker diarization. When enabled, the recognition result contains NoteIf speaker diarization is enabled, we recommend limiting the audio duration to 2 hours to avoid recognition failure or timeout. For an example of |
nls_config.speaker_count | integer | No | A reference value for the number of speakers. To use this feature, set |
nls_config.vocabulary_id | string | No | The hotword vocabulary ID, which improves the recognition accuracy of specific words. This parameter applies to v2 and later models. For more information, see Custom hotwords. |
nls_config.resources | array[object] | No | The hotword resource configuration for v1 models. It provides the same function as |
Key interfaces
NativeNui
initializeFileTrans
Initializes a speech transcription SDK instance. Do not initialize the instance again before you call release.
NoteUnlike real-time speech recognition, non-real-time audio file transcription must use initializeFileTrans and pass an INativeFileTransCallback callback instead of using initialize.
This interface blocks the calling thread. Call it from a non-UI thread.
- Method signature
public initializeFileTrans(callback: INativeFileTransCallback,
parameters: string,
level: number,
save_log: boolean = false): number
- Parameter descriptions
| Parameter | Type | Description |
|---|---|---|
callback | INativeFileTransCallback | An implementation of the file transcription event and data callback interface. |
parameters | string | A JSON string that contains authentication, connection, and debugging parameters. See Connection and control parameters. |
level | number | Controls the SDK log level. Valid values are defined by the Constants.LogLevel enumeration. |
save_log | boolean | Specifies whether to save local logs. If this parameter is |
- Return value
An error code. See Error code reference.
setParams
Sets or updates only the nls_config parameter. If all parameters are provided in startFileTranscriber, you do not need to call this method.
- Method signature
public setParams(params: string): number
- Parameter descriptions
| Parameter | Type | Description |
|---|---|---|
params | string | The |
- Return value
An error code. See Error code reference.
startFileTranscriber
Starts recognition.
- Method signature
public startFileTranscriber(params: string, task_id: ArrayBuffer): number
- Parameter descriptions
| Parameter | Type | Description |
|---|---|---|
params | string | The speech recognition effect parameters. Example: |
task_id | ArrayBuffer | The task ID buffer. The SDK writes an internally generated random task ID string to this buffer. The buffer must be at least 33 bytes long. The example uses |
- Return value
An error code. See Error code reference.
queryFileTranscriber
Queries the current status and result of an asynchronous task. After a successful call, the result is returned by the EVENT_FILE_TRANS_QUERY_RESULT event in the onFileTransEventCallback callback.
- Method signature
public queryFileTranscriber(task_id: string): number
- Parameter descriptions
| Parameter | Type | Description |
|---|---|---|
task_id | string | The ID of the task to query, obtained from the buffer written by |
- Return value
An error code. See Error code reference.
cancelFileTranscriber
Immediately cancels the current task.
- Method signature
public cancelFileTranscriber(task_id: string): number
- Parameter descriptions
| Parameter | Type | Description |
|---|---|---|
task_id | string | The ID of the task to cancel. |
- Return value
An error code. See Error code reference.
release
Releases all internal SDK resources. After this method is called, the SDK instance becomes unavailable. To use it again, call initializeFileTrans to reinitialize it.
- Method signature
public release(): number
- Return value
An error code. See Error code reference.
GetVersion
Obtains the current SDK version information.
- Method signature
public GetVersion(): string
- Return value
The current SDK version information.
INativeFileTransCallback
Defines callbacks for file transcription events and recognition results.
onFileTransEventCallback
Listens for file transcription events and obtains speech recognition results.
- Method signature
onFileTransEventCallback: (event: Constants.NuiEvent, resultCode: number, finish: number,
asrResult: AsrResult, taskId: string) => void;
- Parameter descriptions
| Parameter | Type | Description |
|---|---|---|
event | Constants.NuiEvent | The callback event. |
resultCode | number | The error code. This parameter is valid when |
finish | number | Indicates whether the task has ended. |
asrResult | AsrResult | The speech recognition result. |
taskId | string | The task ID. |
Constants.NuiEvent
HarmonyOS SDK event types are defined by the Constants.NuiEvent enumeration. The following events apply to audio file transcription:
| Event | Description |
|---|---|
EVENT_FILE_TRANS_CONNECTED | The service is connected. |
EVENT_FILE_TRANS_UPLOADED | The audio file to recognize is uploaded. |
EVENT_FILE_TRANS_QUERY_RESULT | The task query result. |
EVENT_FILE_TRANS_RESULT | The final recognition result. |
EVENT_ASR_ERROR | An error occurs during speech recognition. |
Auxiliary types
Constants.LogLevel
The enumeration values for the level parameter are as follows:
| Value | Description |
|---|---|
LOG_LEVEL_VERBOSE | The most detailed logs. |
LOG_LEVEL_DEBUG | Debug logs. |
LOG_LEVEL_INFO | Informational logs (default). |
LOG_LEVEL_WARNING | Warning logs. |
LOG_LEVEL_ERROR | Error logs. |
LOG_LEVEL_NONE | Disables logging. |
Download the result
Non-real-time speech recognition results are generated asynchronously. The response returned by the EVENT_FILE_TRANS_RESULT event contains transcription_url. Download the recognition text in JSON format from this URL. The URL has a validity period. Download the result promptly.