Overview

更新时间:
复制 MD 格式

Queen SDK is a smart retouching SDK developed by the Alibaba Cloud video cloud team. It provides image retouching, face retouching, chroma keying, stickers, makeup, gesture recognition, body shaping, hairdressing, and augmented reality (AR) writing for live streaming, video conferencing, and short video production scenarios.

Introduction

Alibaba Cloud Queen SDK uses in-house intelligent vision algorithms and face and human body detection and recognition technologies. Queen SDK provides video creators with basic face retouching, advanced face retouching, face shaping, makeup, stickers, chroma keying, and gesture and posture recognition on mobile devices. It is available on Android, iOS, and web.

Benefits

  • The proprietary facial keypoint detection technology recognizes 106 basic points and 280 high-accuracy points, producing more vivid retouching effects.

  • The intelligent vision algorithm and real-time rendering technology are regularly optimized to improve user experience.

  • Face retouching and shaping effects, filters, stickers, and materials are continuously updated to provide more retouching options.

  • Comprehensive developer support provides timely solutions to issues and ensures service reliability.

Features

Feature

Description

Face retouching

Supports whole face and manual face retouching. Whole face retouching provides five styles. Manual face retouching lets you whiten, smoothen, and brighten the skin, add rosy cheeks, sharpen images, adjust the saturation and contrast, remove eye bags, nasolabial folds, wrinkles including neck and forehead wrinkles, whiten teeth, brighten eyes, and apply lipstick and blush. You can adjust the intensity level for each effect.

Face shaping

Supports whole face and manual face shaping. Whole face shaping provides five styles. Manual face shaping supports the following effects:

  • One-way shaping: You can slim and trim faces, slim lower jaws, narrow cheekbones, enlarge and widen eyes, and make smiles.

  • Two-way shaping: You can adjust the length of faces, chins, and philtrums, the width of chins, the thickness of lips, the distance between eyes, and the position of hairlines. You can also shape lips and canthi (the corners of the eyes), and resize noses and nose alae (the lateral walls of the nose).

Makeup

Supports whole face makeup and manual makeup. Whole face makeup styles: simple, pure, vintage, and mature. Manual makeup effects: lipstick, aegyo-sal, blush, eyebrow, highlight, eyeshadow, eyeliner, and eyelash. You can adjust the intensity level for each effect. Makeup effects adapt to facial movements and expressions in real time.

Face play

Provides funny effects such as pixelation and facemasks based on face detection and tracking.

Filters

Provides 34 filters, with more being added. Real-time rendering is supported.

Stickers

Provides 79 stickers, including static and animated ones, with new ones being added. Stickers seamlessly match up with faces and adapt to facial movements and expressions in real time.

Chroma keying

Supports both blue and green screens. It precisely identifies and separates the human body from complex backgrounds under various lighting conditions and angles while maintaining real-time body tracking.

Image matting

Supports background replacement in real-world environments. It precisely identifies and separates the human body from complex backgrounds under various lighting conditions and angles while maintaining real-time body tracking.

Note

Background blur, transparent backgrounds, and background replacement can be implemented using this feature.

Gesture recognition

Accurately detects and captures key points of hands and gestures. It recognizes 25 popular gestures such as numbers, heart, fist, claw, and Vulcan salute, along with a variety of dynamic gestures.

Movement detection

Identifies 13 static postures such as hand raising, hand heart, arms akimbo, and superman pose, and 9 movements including rope jumping, jumping jack, squat, arm circle, diamond stretch, chest stretch, sit-up, push-up, and kneeling push-up. Movement repetitions are counted in real time.

Body shaping

Lets you slim bodies, legs, arms, necks, and waists, lengthen legs, resize heads, and enlarge breasts. The natural body shaping effects make bodies look well-proportioned.

Hairdressing

Accurately identifies hair areas in various postures and background environments, and provides 8 hair colors.

AR writing

Tracks hand and finger movements so that you can write or draw on the screen in real time. Useful in live streaming, teaching, and advanced interaction scenarios.

Animoji

Captures facial angles and expression changes. Animojis can be set to change in certain ways based on the facial expression recognition algorithm, creating fun and entertaining effects. 51 expressions are supported, including winking, blinking, and mouth, eye, and eyebrow movements.

Liveness detection

Determines whether the person is live by analyzing movements such as mouth opening, head shaking to the right, and lifting or lowering the head.

Unusual behavior detection

Identifies whether the person is holding a mobile phone or wearing earphones, and whether a display monitor is present. It also detects unusual behaviors such as leaving the camera range, standing up, sitting down, and hand raising.

Face authentication and similarity check

Authenticates faces by grading the similarity from various angles based on facial keypoint detection and characteristics calculation algorithms.

Common scenarios

  • Live streaming

    Ideal for live streaming scenarios that require real-time retouching.

  • Long and short videos

    Offers a rich set of effects for video production.

  • Online education

    Enhances teachers' on-screen appearance with natural retouching effects.

  • Video conferencing

    Delivers real-time retouching and interaction effects during video conferences.

Try Queen SDK