Choose a model for voice conversation, audio and video analysis, content moderation, voice translation, and other omni-modal tasks.
Migrate from closed-source models
Map your current GPT or Gemini omni-modal/real-time capabilities to an equivalent Bailian model.
|
Closed-source examples |
Bailian recommendation |
|
|
Highest capability |
GPT-5.5, Gemini 3.1 Pro |
|
|
Lightweight & low-cost |
GPT-5.4-mini, Gemini 3.1 Flash |
|
|
Real-time translation |
Gemini 3.1 Live |
|
Use cases
Omni-modal models understand text, audio, images, and video simultaneously, producing both text and speech output. Three families are available: Qwen3.5-Omni (flagship), Qwen3-Omni-Flash (lightweight, lower cost, supports thinking mode), and Qwen3.5-Livetranslate (purpose-built translation). Choose by use case:
|
Use case |
Recommended model |
User guide |
|
Real-time voice/video conversation: Interact with AI through a microphone and camera (voice assistants, customer service bots, visual Q&A, live-stream analysis) |
Qwen3.5-Omni Realtime (WebSocket) |
|
|
Audio and video analysis: Upload audio or video files for AI-generated text or speech responses (video content moderation, meeting transcription, caption generation) |
Qwen3.5-Omni (HTTP) |
|
|
Lightweight audio and video analysis: Analyze uploaded audio or video files at lower cost (single input capped at 150 seconds). Supports thinking mode with text-only output |
Qwen3-Omni-Flash (HTTP) |
|
|
Real-time voice translation: Simultaneous interpretation with approximately 3-second latency, supporting 60 languages (live interpretation, multilingual meetings) |
Qwen3.5-Livetranslate (WebSocket) |
|
|
Audio and video file translation: Upload audio or video files and translate them into a target language (video dubbing, podcast translation) |
Qwen3-Livetranslate (HTTP) |
|
|
Voice cloning: Provide a reference audio clip and the AI generates speech responses in that voice |
Qwen3.5-Omni Plus / Flash (HTTP / WebSocket) |
|
|
Real-time voice conversation with semantic VAD: End-to-end voice interaction, semantic turn detection (smart_turn), non-meaningful utterances won't interrupt the conversation, supports Function Calling (voice assistants, smart customer service) |
Qwen-Audio (WebSocket) |
-
For content analysis, Qwen3.5-Omni supports audio up to 3 hours and video up to 1 hour per request.
-
Qwen3.5-Omni (WebSocket + HTTP), Qwen3-Omni-Flash (HTTP only), and Qwen-Audio Realtime (WebSocket) support function calling.
-
Only Qwen3.5-Omni supports web search (HTTP / WebSocket). Web search and function calling cannot be enabled at the same time.
Translation
Multiple omni-modal models support voice translation, each suited to different scenarios.
Quick setup: Qwen3.5-Livetranslate (60 languages, ~3 s latency, out-of-the-box). Highest quality: Qwen3.5-Omni (29 output languages, web search and term injection). Cost-sensitive: Qwen3-Omni-Flash (11 output languages, lower cost).
Recommended models
|
Model ID |
API |
Input |
Function calling |
Web search |
Thinking mode |
|
|
WebSocket |
Text, audio, images |
|
|
|
|
|
HTTP |
Text, audio, images, video |
|
|
|
|
|
WebSocket |
Text, audio, images |
|
|
|
|
|
HTTP |
Text, audio, images, video |
|
|
|
|
|
WebSocket |
Text, audio, images, video |
|
|
|
|
|
HTTP |
Text, audio, images, video |
|
|
|
|
|
WebSocket |
Audio, images |
|
|
|
|
|
HTTP |
Audio, video |
|
|
|
|
|
WebSocket |
Audio, text |
|
|
|
|
|
WebSocket |
Audio, text |
|
|
|
All models
Qwen3.5-Omni
|
Model ID |
API |
Input |
Function calling |
Web search |
Thinking mode |
|
|
WebSocket |
Text, audio, images, video |
|
|
|
|
|
WebSocket |
Text, audio, images, video |
|
|
|
|
|
HTTP |
Text, audio, images, video |
|
|
|
|
|
HTTP |
Text, audio, images, video |
|
|
|
|
|
WebSocket |
Text, audio, images, video |
|
|
|
|
|
WebSocket |
Text, audio, images, video |
|
|
|
|
|
HTTP |
Text, audio, images, video |
|
|
|
|
|
HTTP |
Text, audio, images, video |
|
|
|
Qwen3-Omni
|
Model ID |
API |
Input |
Function calling |
Web search |
Thinking mode |
|
|
WebSocket |
Text, audio, images, video |
|
|
|
|
|
WebSocket |
Text, audio, images, video |
|
|
|
|
|
WebSocket |
Text, audio, images, video |
|
|
|
|
|
HTTP |
Text, audio, images, video |
|
|
|
|
|
HTTP |
Text, audio, images, video |
|
|
|
|
|
HTTP |
Text, audio, images, video |
|
|
|
Qwen3.5-Livetranslate
|
Model ID |
API |
Input |
Languages |
|
|
WebSocket |
Audio |
60 |
|
|
WebSocket |
Audio |
60 |
Qwen3-Livetranslate
|
Model ID |
API |
Input |
Languages |
|
|
WebSocket |
Audio |
18 |
|
|
WebSocket |
Audio |
18 |
|
|
HTTP |
Audio, video |
18 |
|
|
HTTP |
Audio, video |
18 |
Qwen-Audio
|
Model ID |
API |
Input |
Function calling |
Web search |
Thinking mode |
|
|
WebSocket |
Audio, text |
|
|
|
|
|
WebSocket |
Audio, text |
|
|
|
Legacy models
The following models are no longer updated. Use Qwen3.5-Omni for new projects.
|
Model ID |
Input |
API |
|
|
Text, audio, images, video |
HTTP |
|
|
Text, audio, images, video |
HTTP |
|
|
Text, audio, images, video |
HTTP |
|
|
Text, audio, images, video |
HTTP |
|
|
Text, audio |
WebSocket |
|
|
Text, audio |
WebSocket |
|
|
Text, audio |
WebSocket |