Product overview
What is a digitized virtual human
The digital human is a multimodal interactive product from Alibaba DAMO Academy. Its core capability is AI-driven real-time rendering, and it is built on expertise in areas such as speech, image processing, 3D art, and natural language processing. The Digital Human Open Platform provides several products: Digital Human Streaming Media for real-time interaction, Digital Human Video Synthesis for efficient content production, and Brand Smart Live Channel, which specializes in e-commerce live streaming.
Digital human open platform
3D Digital Human Streaming Media: This product animates a 3D digital human to narrate text in real time. You can send text to the server-side through an API. The server then processes the text into the digital human's voice, expressions, lip movements, and actions. The server uses streaming media technology to generate a video stream from this data. This stream is sent to a channel, such as the official Alibaba Cloud RTC or a customer-specified RTMP streaming media server. You can then use the client software development kit (SDK) for that channel to pull the stream and display it on a large screen, mobile phone, or web page.
3D/2D Digital Human Video Synthesis: This product animates a 3D or 2D digital human to narrate text and generates a video offline. You can send text to the server using an API or the Software as a Service (SaaS) page. The server receives the text and processes it into the digital human's voice, expressions, lip movements, and actions. The server then synthesizes this data into a video in your specified format and provides a download link. You can download the video for further editing and distribution.
Brand smart live channel
Merchants on the Taobao and Tmall platforms can use the Brand Smart Live Channel service on the Taobao Live platform. This service provides a virtual human live streaming operation platform and virtual human streamers. These virtual streamers can introduce and sell products and interact with viewers in their store's live channel, just like real human streamers. During the live stream, viewers see the virtual human and can interact with the virtual streamer through dialogue and on-screen clicks.