Add a background sound to an audio/video call between an AI agent and a customer to create a more realistic and immersive experience.
Introduction
The background sound feature lets you dynamically add preset sounds, such as cafe chatter, office noise, or street sounds, during an audio/video call between an AI agent and a customer.
This feature is ideal for scenarios such as customer service, virtual social interactions, and remote interviews. It creates a more natural and authentic call atmosphere without revealing the user's actual environment, enhancing the credibility of the interaction.
Use cases
AI customer service: Enable an "office" or "call center" background sound during calls with an AI agent to simulate a real service environment and increase user trust.
Virtual social interactions: Use background sounds like "cafe" or "park" in virtual dating or companionship scenarios to enhance immersion.
Implementation
Step 1: Upload background sounds in the console
-
Go to the AI Agents page, select an AI agent, and click Manage.
-
Click the Advanced Configurations tab. In the Background Sounds section, you can find several official background sounds.
These include conversation (ID:
public_conversation), customer service (ID:public_customer_service), and outdoor park (ID:public_park). You can click Play audio to preview them. -
You can also upload a custom audio file. On the Custom tab, click Upload to generate a Sound ID for your file.
Uploaded audio files must be in MP3 or WAV format. Each file cannot exceed 1.5 MB, and you can upload a maximum of five files.
Step 2: Set background sounds during a call
Audio and video calls
When you call the StartAIAgentInstance operation, set the AmbientSoundConfig parameter in the AIAgentConfig object.
|
Parameter |
Type |
Description |
Example |
|
ResourceId |
String |
The ID of the background sound. |
public_conversation |
|
Volume |
Integer |
The volume of the background sound. The value must be an integer from 0 to 100, where 0 disables the sound. |
50 |
Outbound calls
When you call the StartAIAgentOutboundCall operation, set the AmbientSoundConfig parameter in the AIAgentOutboundCallConfig object.
|
Parameter |
Type |
Description |
Example |
|
ResourceId |
String |
The ID of the background sound. |
public_conversation |
|
Volume |
Integer |
The volume of the background sound. The value must be an integer from 0 to 100, where 0 disables the sound. |
50 |