Body Keypoint SDK
Detects 15 keypoints in authorized human images, including the nose, eyes, neck, left shoulder, and right shoulder.
Starting May 12, 2026, new licenses will no longer be issued for offline SDK products on the Alibaba Cloud Vision AI Open Platform. Existing users who have already purchased a license can continue to use the service.
Advantages
High precision: Accurately maps human posture by detecting 15 keypoints. The model demonstrates strong robustness against challenging conditions such as poor lighting and image blur.
High efficiency: The algorithm integrates easily and requires minimal CPU and memory. It ensures stable detection between frames, reaching over 20 frames per second (fps) even on low-cost devices.
Low jitter: Optimized for video processing, the SDK minimizes keypoint jitter between frames to ensure stable and smooth tracking.
Use cases
Sports and fitness: Analyze human posture, motion tracks, and joint angles using keypoint data. This can help athletes with training, evaluate workout effectiveness, and improve coaching efficiency.
Interactive entertainment: Enhance applications like interactive streaming platforms and large-screen displays. Use human detection and keypoint analysis to create engaging experiences with virtual accessories and motion-controlled games.
Prerequisites
Activate and authorize the SDK before you start. For details, see Activate and Authorize Offline SDKs.
Billing
For information on billing for the Body Keypoint SDK, see Billing of Offline SDKs.
Supported platforms
Android, iOS
Limitations
Android: Requires Android 5.0 or later. The device must include a camera module and a gyroscope module.
iOS: Requires iOS 10 or later. Supported on iPhone 5s and later models. The device must include a camera module.
Recommended camera resolution: For optimal performance, use a camera resolution between 640x480 and 1280x720 pixels. Higher resolution decreases SDK performance.
To use the SDK on models earlier than iPhone 5s, or on low-end Android devices, please contact us.
Integration
This SDK does not transmit any data to the SDK provider. Therefore, if you use this SDK to collect personal information, you are considered the data processor. The SDK provider is not a data processor or a sub-processor. You must fully inform users and obtain their authorization in accordance with relevant laws and regulations. When informing users, ensure that the SDK provider is not identified as a data processor or a sub-processor.
Android: Android Integration Guide.
iOS: iOS Integration Guide.
Open-source models
To try and download more free open-source models, visit the ModelScope community. Available models include HRNet Human Keypoints-2D and Full Body Keypoint Detection-General-2D.