视频人像分割

本文档为您介绍视频人像分割能力常用语言和常见情况的示例代码。

说明
  • 您可以进入在线咨询获取在线人工帮助。

  • 阿里云视觉智能开放平台视觉AI能力API接入、接口使用或问题咨询等,请通过钉钉群(23109592)加入阿里云视觉智能开放平台咨询群联系我们。

能力介绍

关于视频人像分割能力的功能介绍以及具体调用参数说明,请参见视频人像分割

SDK包安装

常见语言的SDK依赖包信息,请参见SDK总览

配置环境变量

配置环境变量ALIBABA_CLOUD_ACCESS_KEY_IDALIBABA_CLOUD_ACCESS_KEY_SECRET

重要
  • 阿里云账号AccessKey拥有所有API的访问权限,建议您使用RAM用户进行API访问或日常运维,具体操作,请参见创建RAM用户

  • 请不要将AccessKey ID和AccessKey Secret保存到工程代码里,否则可能导致AccessKey泄露,威胁您账号下所有资源的安全。

  • Linux和macOS系统配置方法

    1. 在IntelliJ IDEA中打开终端Terminal。

    2. 执行以下命令,配置环境变量。

      <access_key_id>需替换为您RAM用户的AccessKey ID,<access_key_secret>替换为您RAM用户的AccessKey Secret。如果后续需要进行更多权限相关的配置,具体操作请参见使用RAM Policy控制访问权限

      export ALIBABA_CLOUD_ACCESS_KEY_ID=<access_key_id> 
      export ALIBABA_CLOUD_ACCESS_KEY_SECRET=<access_key_secret>
  • Windows系统配置方法

    新建环境变量文件,添加环境变量ALIBABA_CLOUD_ACCESS_KEY_IDALIBABA_CLOUD_ACCESS_KEY_SECRET,并写入已准备好的AccessKey ID和AccessKey Secret。然后重启Windows系统。本操作以Windows 10为例进行说明。

    1. 打开文件资源管理器,在此电脑上右键单击属性。

    2. 在右侧导航栏,单击高级系统配置

    3. 系统属性对话框的高级页签下,单击环境变量

    4. 环境变量对话框中,单击新建(W)image.png

    5. 在弹出的新建系统变量对话框中,添加环境变量ALIBABA_CLOUD_ACCESS_KEY_IDALIBABA_CLOUD_ACCESS_KEY_SECRET,并写入已准备好的AccessKey ID和AccessKey Secret。

    6. 重启Windows系统,使配置生效。

示例代码

文件在上海地域OSS

该能力常用语言查询异步任务结果的示例代码,请参见查询异步任务结果

// 引入依赖包
// 最低SDK版本要求:videoseg20200320的SDK版本需大于等于1.0.3。
// 可以在此仓库地址中引用最新版本SDK:https://mvnrepository.com/artifact/com.aliyun/videoseg20200320
// <dependency>
//       <groupId>com.aliyun</groupId>
//       <artifactId>videoseg20200320</artifactId>
//       <version>${aliyun.videoseg.version}</version>
// </dependency>

import com.aliyun.tea.TeaException;
import com.aliyun.tea.TeaModel;
import com.aliyun.videoseg20200320.models.SegmentVideoBodyResponse;

public class SegmentVideoBody {

    public static com.aliyun.videoseg20200320.Client createClient(String accessKeyId, String accessKeySecret) throws Exception {
        /*
          初始化配置对象com.aliyun.teaopenapi.models.Config
          Config对象存放 AccessKeyId、AccessKeySecret、endpoint等配置
         */
         com.aliyun.teaopenapi.models.Config config = new com.aliyun.teaopenapi.models.Config()
                .setAccessKeyId(accessKeyId)
                .setAccessKeySecret(accessKeySecret);
        // 访问的域名
        config.endpoint = "videoseg.cn-shanghai.aliyuncs.com";
        return new com.aliyun.videoseg20200320.Client(config);
    }

    public static void main(String[] args) throws Exception {
        // 创建AccessKey ID和AccessKey Secret,请参见:https://help.aliyun.com/document_detail/175144.html
        // 如果您使用的是RAM用户的AccessKey,还需要为子账号授予权限AliyunVIAPIFullAccess,请参见:https://help.aliyun.com/document_detail/145025.html
        // 从环境变量读取配置的AccessKey ID和AccessKey Secret。运行代码示例前必须先配置环境变量。
        String accessKeyId = System.getenv("ALIBABA_CLOUD_ACCESS_KEY_ID");
        String accessKeySecret = System.getenv("ALIBABA_CLOUD_ACCESS_KEY_SECRET"); 
        com.aliyun.videoseg20200320.Client client = SegmentVideoBody.createClient(accessKeyId, accessKeySecret);
        com.aliyun.videoseg20200320.models.SegmentVideoBodyRequest segmentVideoBodyRequest = new com.aliyun.videoseg20200320.models.SegmentVideoBodyRequest()
                .setVideoUrl("http://viapi-test.oss-cn-shanghai.aliyuncs.com/viapi-3.0domepic/videoseg/SegmentVideoBody/SegmentVideoBody1.mp4");
        com.aliyun.teautil.models.RuntimeOptions runtime = new com.aliyun.teautil.models.RuntimeOptions();
        try {
            // 复制代码运行请自行打印 API 的返回值
            SegmentVideoBodyResponse response = client.segmentVideoBodyWithOptions(segmentVideoBodyRequest, runtime);
            System.out.println(com.aliyun.teautil.Common.toJSONString(TeaModel.buildMap(response)));
        } catch (TeaException error) {
            // 获取整体报错信息
            System.out.println(com.aliyun.teautil.Common.toJSONString(error));
            // 获取单个字段
            System.out.println(error.getCode());
        }
    }
}
# -*- coding: utf-8 -*-
# 引入依赖包
# pip install alibabacloud_videoseg20200320
# 最低SDK版本要求:videoseg20200320的SDK版本需大于等于3.0.2。
# 可以在此仓库地址中引用最新版本SDK:https://pypi.org/project/alibabacloud-videoseg20200320/

import os
from alibabacloud_tea_openapi.models import Config
from alibabacloud_tea_util.models import RuntimeOptions
from alibabacloud_videoseg20200320.client import Client
from alibabacloud_videoseg20200320.models import SegmentVideoBodyRequest

config = Config(
  # 创建AccessKey ID和AccessKey Secret,请参考https://help.aliyun.com/document_detail/175144.html
  # 如果您用的是RAM用户的AccessKey,还需要为RAM用户授予权限AliyunVIAPIFullAccess,请参考https://help.aliyun.com/document_detail/145025.html
  # 从环境变量读取配置的AccessKey ID和AccessKey Secret。运行代码示例前必须先配置环境变量。
  access_key_id=os.environ.get('ALIBABA_CLOUD_ACCESS_KEY_ID'),
  access_key_secret=os.environ.get('ALIBABA_CLOUD_ACCESS_KEY_SECRET'),
  # 访问的域名
  endpoint='videoseg.cn-shanghai.aliyuncs.com',
  # 访问的域名对应的region
  region_id='cn-shanghai'
)
segment_video_body_request = SegmentVideoBodyRequest(
    video_url='http://viapi-test.oss-cn-shanghai.aliyuncs.com/viapi-3.0domepic/videoseg/SegmentVideoBody/SegmentVideoBody1.mp4'
)
runtime = RuntimeOptions()
try:
  # 初始化Client
  client = Client(config)
  response = client.segment_video_body_with_options(segment_video_body_request, runtime)
  # 获取整体结果
  print(response.body)
except Exception as error:
  # 获取整体报错信息
  print(error)
  # 获取单个字段
  print(error.code)
<?php

//安装依赖包
//最低SDK版本要求:videoseg-20200320的SDK版本需大于等于1.0.4。
//可以在此仓库地址中引用最新版本SDK:https://packagist.org/packages/alibabacloud/videoseg-20200320
//composer require alibabacloud/videoseg-20200320


use AlibabaCloud\SDK\Videoseg\V20200320\Videoseg;
use \Exception;
use AlibabaCloud\Tea\Utils\Utils;
use Darabonba\OpenApi\Models\Config;
use AlibabaCloud\SDK\Videoseg\V20200320\Models\SegmentVideoBodyRequest;
use AlibabaCloud\Tea\Utils\Utils\RuntimeOptions;

class SegmentVideoBody {

    /**
     * 使用AK&SK初始化账号Client
     * @param string $accessKeyId
     * @param string $accessKeySecret
     * @return Videoseg Client
     */
    public static function createClient($accessKeyId, $accessKeySecret){
        //初始化配置对象Darabonba\OpenApi\Models\Config。
        //Config对象存放accessKeyId、accessKeySecret、endpoint等配置
        $config = new Config([
            "accessKeyId" => $accessKeyId,
            "accessKeySecret" => $accessKeySecret
        ])
        // 访问的域名
        $config->endpoint = "videoseg.cn-shanghai.aliyuncs.com";
        return new Videoseg($config);
    }

    /**
     * @param string[] $args
     * @return void
     */
    public static function main($args){
        // 创建AccessKey ID和AccessKey Secret,请参考https://help.aliyun.com/document_detail/175144.html。
        // 如果您用的是RAM用户的AccessKey,还需要为RAM用户授予权限AliyunVIAPIFullAccess,请参考https://help.aliyun.com/document_detail/145025.html。
        // 从环境变量读取配置的AccessKey ID和AccessKey Secret。运行示例前必须先配置环境变量。    
        $accessKeyId = getenv('ALIBABA_CLOUD_ACCESS_KEY_ID');      
        $accessKeySecret = getenv('ALIBABA_CLOUD_ACCESS_KEY_SECRET');
        $client = self::createClient($accessKeyId, $accessKeySecret);
        $segmentVideoBodyRequest = new SegmentVideoBodyRequest([
            "videoUrl" => "http://viapi-test.oss-cn-shanghai.aliyuncs.com/viapi-3.0domepic/videoseg/SegmentVideoBody/SegmentVideoBody1.mp4"
        ]);
        $runtime = new RuntimeOptions([]);
        try {
            $resp = $client->segmentVideoBodyWithOptions($segmentVideoBodyRequest, $runtime);
            # 获取整体结果
            echo Utils::toJSONString($resp->body);
        } catch (Exception $exception) {
            # 获取整体报错信息
            echo Utils::toJSONString($exception);
            # 获取单个字段
            echo $exception->getCode();
        }
    }
}
$path = __DIR__ . \DIRECTORY_SEPARATOR . '..' . \DIRECTORY_SEPARATOR . 'vendor' . \DIRECTORY_SEPARATOR . 'autoload.php';
if (file_exists($path)) {
    require_once $path;
}
//$argv是预留的数组入参参数,无实际意义,无需进行修改
SegmentVideoBody::main(array_slice($argv, 1));
// 安装依赖包
// npm install @alicloud/videoseg20200320
// 最低SDK版本要求:videoseg20200320的SDK版本需大于等于3.0.2
// 可以在此仓库地址中引用最新版本SDK:https://npmjs.com/package/@alicloud/videoseg20200320
const VideosegClient = require('@alicloud/videoseg20200320');
const OpenapiClient = require('@alicloud/openapi-client');
const TeaUtil = require('@alicloud/tea-util');

let config = new OpenapiClient.Config({
  // 创建AccessKey ID和AccessKey Secret,请参考https://help.aliyun.com/document_detail/175144.html。
  // 如果您用的是RAM用户AccessKey,还需要为RAM用户授予权限AliyunVIAPIFullAccess,请参考https://help.aliyun.com/document_detail/145025.html。
  // 从环境变量读取配置的AccessKey ID和AccessKey Secret。运行示例前必须先配置环境变量。 
  accessKeyId: process.env.ALIBABA_CLOUD_ACCESS_KEY_ID,   
  accessKeySecret: process.env.ALIBABA_CLOUD_ACCESS_KEY_SECRET
});
// 访问的域名
config.endpoint = `videoseg.cn-shanghai.aliyuncs.com`;
const client = new VideosegClient.default(config);
let segmentVideoBodyRequest = new VideosegClient.SegmentVideoBodyRequest({
    videoUrl: "http://viapi-test.oss-cn-shanghai.aliyuncs.com/viapi-3.0domepic/videoseg/SegmentVideoBody/SegmentVideoBody1.mp4",
  });
let runtime = new TeaUtil.RuntimeOptions({ });
client.segmentVideoBodyWithOptions(segmentVideoBodyRequest, runtime)
  .then(function(segmentVideoBodyResponse) {
    // 获取整体结果
    console.log(segmentVideoBodyResponse);
    // 获取单个字段
    console.log(segmentVideoBodyResponse.body.data);
  }, function(error) {
    // 获取整体报错信息
    console.log(error);
    // 获取单个字段
    console.log(error.data.Code);
  })
// 引入依赖包
// 最低SDK版本要求:videoseg20200320的SDK版本需大于等于2.0.3。
// 可以在此仓库地址中引用最新版本SDK:github.com/alibabacloud-go/videoseg-20200320/v2
// go get github.com/alibabacloud-go/videoseg-20200320/v2

package main

import (
	"fmt"
	openapi "github.com/alibabacloud-go/darabonba-openapi/v2/client"
	util "github.com/alibabacloud-go/tea-utils/v2/service"
	"github.com/alibabacloud-go/tea/tea"
	videoseg20200320 "github.com/alibabacloud-go/videoseg-20200320/v2/client"
)

func main() {
	// 创建AccessKey ID和AccessKey Secret,请参考https://help.aliyun.com/document_detail/175144.html。
	// 如果您用的是RAM用户的AccessKey,还需要为RAM用户授予权限AliyunVIAPIFullAccess,请参考https://help.aliyun.com/document_detail/145025.html。
	// 从环境变量读取配置的AccessKey ID和AccessKey Secret。运行示例前必须先配置环境变量。  
	accessKeyId := os.Getenv("ALIBABA_CLOUD_ACCESS_KEY_ID")  
	accessKeySecret := os.Getenv("ALIBABA_CLOUD_ACCESS_KEY_SECRET")
	// 初始化配置对象 &openapi.Config。Config对象存放AccessKeyId、AccessKeySecret、Endpoint等配置。
	config := &openapi.Config{
		AccessKeyId: tea.String(accessKeyId),
		AccessKeySecret: tea.String(accessKeySecret)
	}
	// 访问的域名
	config.Endpoint = tea.String("videoseg.cn-shanghai.aliyuncs.com")
	client, err := videoseg20200320.NewClient(config)
	if err != nil {
		fmt.Println(err.Error())
	}

	segmentVideoBodyRequest := &videoseg20200320.SegmentVideoBodyRequest{
		VideoUrl: tea.String("http://viapi-test.oss-cn-shanghai.aliyuncs.com/viapi-3.0domepic/videoseg/SegmentVideoBody/SegmentVideoBody1.mp4"),
	}
	runtime := &util.RuntimeOptions{}
	segmentVideoBodyResponse, _err := client.SegmentVideoBodyWithOptions(segmentVideoBodyRequest, runtime)
	if _err != nil {
		fmt.Println(_err.Error())
	} else {
		// 获取整体结果
		fmt.Println(segmentVideoBodyResponse)
		// 获取单个字段
		fmt.Println(segmentVideoBodyResponse.Body.Data)
	}
}
// 安装依赖包
// dotnet add package AlibabaCloud.SDK.Videoseg20200320
// 最低SDK版本要求:videoseg20200320的SDK版本需大于等于2.0.2
// 可以在此仓库地址中引用最新版本SDK:https://nuget.org/packages/AlibabaCloud.SDK.Videoseg20200320
using System;
using System.Collections;
using System.Collections.Generic;
using System.Drawing;
using System.IO;
using System.Net;
using System.Threading.Tasks;
using AlibabaCloud.SDK.Videoseg20200320.Models;
using Tea;
using Tea.Utils;

namespace AlibabaCloud.SDK.Sample
{
    public class Sample
    {
        /**
            * 使用AK&SK初始化账号Client
            * @param accessKeyId
            * @param accessKeySecret
            * @return Client
            * @throws Exception
        */
        public static AlibabaCloud.SDK.Videoseg20200320.Client CreateClient(string accessKeyId, string accessKeySecret)
        {
            AlibabaCloud.OpenApiClient.Models.Config config = new AlibabaCloud.OpenApiClient.Models.Config
            {
                AccessKeyId = accessKeyId,
                AccessKeySecret = accessKeySecret,
            };
            // 访问的域名
            config.Endpoint = "videoseg.cn-shanghai.aliyuncs.com";
            return new AlibabaCloud.SDK.Videoseg20200320.Client(config);
        }
        public static void Main(string[] args)
        {
            // 创建AccessKey ID和AccessKey Secret,请参考https://help.aliyun.com/document_detail/175144.html
            // 如果您使用的是RAM用户的AccessKey,还需要为子账号授予权限AliyunVIAPIFullAccess,请参考https://help.aliyun.com/document_detail/145025.html
            // 从环境变量读取配置的AccessKey ID和AccessKey Secret。运行代码示例前必须先配置环境变量。
            AlibabaCloud.SDK.Videoseg20200320.Client client = CreateClient(System.Environment.GetEnvironmentVariable("ALIBABA_CLOUD_ACCESS_KEY_ID"), System.Environment.GetEnvironmentVariable("ALIBABA_CLOUD_ACCESS_KEY_SECRET"));
            AlibabaCloud.SDK.Videoseg20200320.Models.SegmentVideoBodyRequest segmentVideoBodyRequest = new AlibabaCloud.SDK.Videoseg20200320.Models.SegmentVideoBodyRequest
            {
                VideoUrl = "http://viapi-test.oss-cn-shanghai.aliyuncs.com/viapi-3.0domepic/videoseg/SegmentVideoBody/SegmentVideoBody1.mp4",
            };
            AlibabaCloud.TeaUtil.Models.RuntimeOptions runtime = new AlibabaCloud.TeaUtil.Models.RuntimeOptions();
            try
            {
                AlibabaCloud.SDK.Videoseg20200320.Models.SegmentVideoBodyResponse segmentVideoBodyResponse = client.SegmentVideoBodyWithOptions(segmentVideoBodyRequest, runtime);
                // 获取整体结果
                Console.WriteLine(AlibabaCloud.TeaUtil.Common.ToJSONString(segmentVideoBodyResponse.Body));
                // 获取单个字段
                Console.WriteLine(AlibabaCloud.TeaUtil.Common.ToJSONString(segmentVideoBodyResponse.Body.Data));
            }
            catch (TeaException error)
            {
                // 如有需要,请打印 error
                AlibabaCloud.TeaUtil.Common.AssertAsString(error.Message);
            }
            catch (Exception _error)
            {
                TeaException error = new TeaException(new Dictionary<string, object>
                {
                    { "message", _error.Message }
                });
                // 如有需要,请打印 error
                Console.WriteLine(error.Message);
            }
        }
    }
}

文件在本地或可访问的URL

该能力常用语言查询异步任务结果的示例代码,请参见查询异步任务结果

// 引入依赖包
// 最低SDK版本要求:videoseg20200320的SDK版本需大于等于1.0.3。
// 可以在此仓库地址中引用最新版本SDK:https://mvnrepository.com/artifact/com.aliyun/videoseg20200320
// <dependency>
//       <groupId>com.aliyun</groupId>
//       <artifactId>videoseg20200320</artifactId>
//       <version>${aliyun.videoseg.version}</version>
// </dependency>

import com.aliyun.tea.TeaException;
import com.aliyun.tea.TeaModel;
import com.aliyun.videoseg20200320.models.SegmentVideoBodyResponse;

import java.io.File;
import java.io.FileInputStream;
import java.io.InputStream;
import java.net.URL;

public class SegmentVideoBody {

    public static com.aliyun.videoseg20200320.Client createClient(String accessKeyId, String accessKeySecret) throws Exception {
        /*
          初始化配置对象com.aliyun.teaopenapi.models.Config
          Config对象存放 AccessKeyId、AccessKeySecret、endpoint等配置
         */
         com.aliyun.teaopenapi.models.Config config = new com.aliyun.teaopenapi.models.Config()
                .setAccessKeyId(accessKeyId)
                .setAccessKeySecret(accessKeySecret);
        // 访问的域名
        config.endpoint = "videoseg.cn-shanghai.aliyuncs.com";
        return new com.aliyun.videoseg20200320.Client(config);
    }

    public static void main(String[] args) throws Exception {
        // 创建AccessKey ID和AccessKey Secret,请参见:https://help.aliyun.com/document_detail/175144.html
        // 如果您使用的是RAM用户的AccessKey,还需要为子账号授予权限AliyunVIAPIFullAccess,请参见:https://help.aliyun.com/document_detail/145025.html
        // 从环境变量读取配置的AccessKey ID和AccessKey Secret。运行代码示例前必须先配置环境变量。
        String accessKeyId = System.getenv("ALIBABA_CLOUD_ACCESS_KEY_ID");
        String accessKeySecret = System.getenv("ALIBABA_CLOUD_ACCESS_KEY_SECRET"); 
        com.aliyun.videoseg20200320.Client client = SegmentVideoBody.createClient(accessKeyId, accessKeySecret);
        // 场景一,使用本地文件
        //InputStream inputStream = new FileInputStream(new File("/tmp/SegmentVideoBody1.mp4"));
        // 场景二,使用任意可访问的url
        URL url = new URL("https://viapi-test-bj.oss-cn-beijing.aliyuncs.com/viapi-3.0domepic/videorecog/EvaluateVideoQuality/EvaluateVideoQuality1.mp4");
        InputStream inputStream = url.openConnection().getInputStream();
        com.aliyun.videoseg20200320.models.SegmentVideoBodyAdvanceRequest segmentVideoBodyAdvanceRequest = new com.aliyun.videoseg20200320.models.SegmentVideoBodyAdvanceRequest()
                .setVideoUrlObject(inputStream);
        com.aliyun.teautil.models.RuntimeOptions runtime = new com.aliyun.teautil.models.RuntimeOptions();
        try {
            // 复制代码运行请自行打印 API 的返回值
            SegmentVideoBodyResponse response = client.segmentVideoBodyAdvance(segmentVideoBodyAdvanceRequest, runtime);
            System.out.println(com.aliyun.teautil.Common.toJSONString(TeaModel.buildMap(response)));
        } catch (TeaException error) {
            // 获取整体报错信息
            System.out.println(com.aliyun.teautil.Common.toJSONString(error));
            // 获取单个字段
            System.out.println(error.getCode());
        }
    }
}
# -*- coding: utf-8 -*-
# 引入依赖包
# pip install alibabacloud_videoseg20200320
# 最低SDK版本要求:videoseg20200320的SDK版本需大于等于3.0.2。
# 可以在此仓库地址中引用最新版本SDK:https://pypi.org/project/alibabacloud-videoseg20200320/

import os
import io
from urllib.request import urlopen
from alibabacloud_tea_openapi.models import Config
from alibabacloud_tea_util.models import RuntimeOptions
from alibabacloud_videoseg20200320.client import Client
from alibabacloud_videoseg20200320.models import SegmentVideoBodyAdvanceRequest

config = Config(
  # 创建AccessKey ID和AccessKey Secret,请参考https://help.aliyun.com/document_detail/175144.html
  # 如果您用的是RAM用户的AccessKey,还需要为RAM用户授予权限AliyunVIAPIFullAccess,请参考https://help.aliyun.com/document_detail/145025.html
  # 从环境变量读取配置的AccessKey ID和AccessKey Secret。运行代码示例前必须先配置环境变量。
  access_key_id=os.environ.get('ALIBABA_CLOUD_ACCESS_KEY_ID'),
  access_key_secret=os.environ.get('ALIBABA_CLOUD_ACCESS_KEY_SECRET'),
  # 访问的域名
  endpoint='videoseg.cn-shanghai.aliyuncs.com',
  # 访问的域名对应的region
  region_id='cn-shanghai'
)
#场景一:文件在本地
#img = open(r'/tmp/SegmentVideoBody1.mp4', 'rb')
#场景二:使用任意可访问的url
url = 'https://viapi-test-bj.oss-cn-beijing.aliyuncs.com/viapi-3.0domepic/videoseg/SegmentVideoBody/SegmentVideoBody1.mp4'
img = io.BytesIO(urlopen(url).read())
segment_video_body_request = SegmentVideoBodyAdvanceRequest()
segment_video_body_request.video_url_object = img
runtime = RuntimeOptions()
try:
  # 初始化Client
  client = Client(config)
  response = client.segment_video_body_advance(segment_video_body_request, runtime)
  # 获取整体结果
  print(response.body)
except Exception as error:
  # 获取整体报错信息
  print(error)
  # 获取单个字段
  print(error.code)
<?php

//安装依赖包
//最低SDK版本要求:videoseg-20200320的SDK版本需大于等于1.0.4。
//可以在此仓库地址中引用最新版本SDK:https://packagist.org/packages/alibabacloud/videoseg-20200320
//composer require alibabacloud/videoseg-20200320


use AlibabaCloud\SDK\Videoseg\V20200320\Videoseg;
use \Exception;
use AlibabaCloud\Tea\Utils\Utils;
use Darabonba\OpenApi\Models\Config;
use AlibabaCloud\SDK\Videoseg\V20200320\Models\SegmentVideoBodyAdvanceRequest;
use AlibabaCloud\Tea\Utils\Utils\RuntimeOptions;
use GuzzleHttp\Psr7\Stream;

class SegmentVideoBodyAdvance {

    /**
     * 使用AK&SK初始化账号Client
     * @param string $accessKeyId
     * @param string $accessKeySecret
     * @return Videoseg Client
     */
    public static function createClient($accessKeyId, $accessKeySecret){
        //初始化配置对象Darabonba\OpenApi\Models\Config。
        //Config对象存放accessKeyId、accessKeySecret、endpoint等配置
        $config = new Config([
            "accessKeyId" => $accessKeyId,
            "accessKeySecret" => $accessKeySecret
        ]);
        // 访问的域名
        $config->endpoint = "videoseg.cn-shanghai.aliyuncs.com";
        return new Videoseg($config);
    }

    /**
     * @param string[] $args
     * @return void
     */
    public static function main($args){
        // 创建AccessKey ID和AccessKey Secret,请参考https://help.aliyun.com/document_detail/175144.html。
        // 如果您用的是RAM用户的AccessKey,还需要为RAM用户授予权限AliyunVIAPIFullAccess,请参考https://help.aliyun.com/document_detail/145025.html。
        // 从环境变量读取配置的AccessKey ID和AccessKey Secret。运行示例前必须先配置环境变量。    
        $accessKeyId = getenv('ALIBABA_CLOUD_ACCESS_KEY_ID');      
        $accessKeySecret = getenv('ALIBABA_CLOUD_ACCESS_KEY_SECRET');
        $client = self::createClient($accessKeyId, $accessKeySecret);
        // 场景一,使用本地文件
        //$file = fopen('/tmp/SegmentVideoBody1.mp4', 'rb');
        //$stream = new Stream($file);
        // 场景二,使用任意可访问的url
        $file = fopen('https://viapi-test-bj.oss-cn-beijing.aliyuncs.com/viapi-3.0domepic/videoseg/SegmentVideoBody/SegmentVideoBody1.mp4', 'rb');
        $stream = new Stream($file);
        $segmentVideoBodyAdvanceRequest = new SegmentVideoBodyAdvanceRequest([
            "videoUrlObject" => $stream
        ]);
        $runtime = new RuntimeOptions([]);
        try {
            $resp = $client->segmentVideoBodyAdvance($segmentVideoBodyAdvanceRequest, $runtime);
            # 获取整体结果
            echo Utils::toJSONString($resp->body);
        } catch (Exception $exception) {
            # 获取整体报错信息
            echo Utils::toJSONString($exception);
            # 获取单个字段
            echo $exception->getCode();
        }
    }
}
$path = __DIR__ . \DIRECTORY_SEPARATOR . '..' . \DIRECTORY_SEPARATOR . 'vendor' . \DIRECTORY_SEPARATOR . 'autoload.php';
if (file_exists($path)) {
    require_once $path;
}
//$argv是预留的数组入参参数,无实际意义,无需进行修改
SegmentVideoBodyAdvance::main(array_slice($argv, 1));
// 安装依赖包
// npm install @alicloud/videoseg20200320
// 最低SDK版本要求:videoseg20200320的SDK版本需大于等于3.0.2
// 可以在此仓库地址中引用最新版本SDK:https://npmjs.com/package/@alicloud/videoseg20200320
const VideosegClient = require('@alicloud/videoseg20200320');
const OpenapiClient = require('@alicloud/openapi-client');
const TeaUtil = require('@alicloud/tea-util');
const fs = require('fs');
const http = require('http');
const https = require('https');

let config = new OpenapiClient.Config({
  // 创建AccessKey ID和AccessKey Secret,请参考https://help.aliyun.com/document_detail/175144.html。
  // 如果您用的是RAM用户AccessKey,还需要为RAM用户授予权限AliyunVIAPIFullAccess,请参考https://help.aliyun.com/document_detail/145025.html。
  // 从环境变量读取配置的AccessKey ID和AccessKey Secret。运行示例前必须先配置环境变量。 
  accessKeyId: process.env.ALIBABA_CLOUD_ACCESS_KEY_ID,   
  accessKeySecret: process.env.ALIBABA_CLOUD_ACCESS_KEY_SECRET
});
// 访问的域名
config.endpoint = `videoseg.cn-shanghai.aliyuncs.com`;
const client = new VideosegClient.default(config);
const getResponse = function (httpClient, url) {
  return new Promise((resolve, reject) => {
    httpClient.get(url, function (response) {
      resolve(response);
    })
  })
}
const request = async function () {
  try {
    const segmentVideoBodyAdvanceRequest = new VideosegClient.SegmentVideoBodyAdvanceRequest();
    // 场景一,使用本地文件
    // const fileStream = fs.createReadStream('/tmp/SegmentVideoBody1.mp4');
    // segmentVideoBodyAdvanceRequest.videoUrlObject = fileStream;
    // 场景二,使用任意可访问的url
    const url = new URL("https://viapi-test-bj.oss-cn-beijing.aliyuncs.com/viapi-3.0domepic/videorecog/EvaluateVideoQuality/EvaluateVideoQuality1.mp4");
    const httpClient = (url.protocol == "https:") ? https : http;
    segmentVideoBodyAdvanceRequest.videoUrlObject = await getResponse(httpClient, url);
    let runtime = new TeaUtil.RuntimeOptions({});
    client.segmentVideoBodyAdvance(segmentVideoBodyAdvanceRequest, runtime)
      .then(function (segmentVideoBodyResponse) {
        // 获取整体结果
        console.log(segmentVideoBodyResponse);
        // 获取单个字段
        //console.log(segmentVideoBodyResponse.body.data);
      }, function (error) {
        // 获取整体报错信息
        console.log(error);
        // 获取单个字段
        console.log(error.data.Code);
      })
  } catch (error) {
    console.log(error);
  }
}();
	// 引入依赖包
// 最低SDK版本要求:videoseg20200320的SDK版本需大于等于2.0.3。
// 可以在此仓库地址中引用最新版本SDK:github.com/alibabacloud-go/videoseg-20200320/v2
// go get github.com/alibabacloud-go/videoseg-20200320/v2

package main

import (
	"fmt"
	openapi "github.com/alibabacloud-go/darabonba-openapi/v2/client"
	util "github.com/alibabacloud-go/tea-utils/v2/service"
	"github.com/alibabacloud-go/tea/tea"
	videoseg20200320 "github.com/alibabacloud-go/videoseg-20200320/v2/client"
	"net/http"
)

func main() { 
	// 创建AccessKey ID和AccessKey Secret,请参考https://help.aliyun.com/document_detail/175144.html。
	// 如果您用的是RAM用户的AccessKey,还需要为RAM用户授予权限AliyunVIAPIFullAccess,请参考https://help.aliyun.com/document_detail/145025.html。
	// 从环境变量读取配置的AccessKey ID和AccessKey Secret。运行示例前必须先配置环境变量。  
	accessKeyId := os.Getenv("ALIBABA_CLOUD_ACCESS_KEY_ID")  
	accessKeySecret := os.Getenv("ALIBABA_CLOUD_ACCESS_KEY_SECRET")
	// 初始化配置对象 &openapi.Config。Config对象存放AccessKeyId、AccessKeySecret、Endpoint等配置。
	config := &openapi.Config{
		AccessKeyId: tea.String(accessKeyId),
		AccessKeySecret: tea.String(accessKeySecret)
	}
	// 访问的域名
	config.Endpoint = tea.String("videoseg.cn-shanghai.aliyuncs.com")
	client, err := videoseg20200320.NewClient(config)
	if err != nil {
		fmt.Println(err.Error())
	}

	// 场景一,使用本地文件
	//file, err := os.Open("/tmp/SegmentVideoBody1.mp4")
	//if err != nil {
	//	fmt.Println("can not open file", err)
	//}
	//segmentVideoBodyAdvanceRequest := &videoseg20200320.SegmentVideoBodyAdvanceRequest{
	//	VideoUrlObject: file,
	//}
	// 场景二,使用任意可访问的url
	httpClient := http.Client{}
	file1, _ := httpClient.Get("https://viapi-test-bj.oss-cn-beijing.aliyuncs.com/viapi-3.0domepic/videorecog/EvaluateVideoQuality/EvaluateVideoQuality1.mp4")
	segmentVideoBodyAdvanceRequest := &videoseg20200320.SegmentVideoBodyAdvanceRequest{
		VideoUrlObject: file1.Body,
	}
	runtime := &util.RuntimeOptions{}
	segmentVideoBodyResponse, _err := client.SegmentVideoBodyAdvance(segmentVideoBodyAdvanceRequest, runtime)
	if _err != nil {
		fmt.Println(_err.Error())
	} else {
		// 获取整体结果
		fmt.Println(segmentVideoBodyResponse)
		// 获取单个字段
		fmt.Println(segmentVideoBodyResponse.Body.Data)
	}
}
// 安装依赖包
// dotnet add package AlibabaCloud.SDK.Videoseg20200320
// 最低SDK版本要求:videoseg20200320的SDK版本需大于等于2.0.2
// 可以在此仓库地址中引用最新版本SDK:https://nuget.org/packages/AlibabaCloud.SDK.Videoseg20200320
using System;
using System.Collections;
using System.Collections.Generic;
using System.Drawing;
using System.IO;
using System.Net;
using System.Threading.Tasks;
using AlibabaCloud.SDK.Videoseg20200320.Models;
using Tea;
using Tea.Utils;

namespace AlibabaCloud.SDK.Sample
{
    public class Sample
    {
        /**
            * 使用AK&SK初始化账号Client
            * @param accessKeyId
            * @param accessKeySecret
            * @return Client
            * @throws Exception
        */
        public static AlibabaCloud.SDK.Videoseg20200320.Client CreateClient(string accessKeyId, string accessKeySecret)
        {
            AlibabaCloud.OpenApiClient.Models.Config config = new AlibabaCloud.OpenApiClient.Models.Config
            {
                AccessKeyId = accessKeyId,
                AccessKeySecret = accessKeySecret,
            };
            // 访问的域名
            config.Endpoint = "videoseg.cn-shanghai.aliyuncs.com";
            return new AlibabaCloud.SDK.Videoseg20200320.Client(config);
        }
        public static void Main(string[] args)
        {
            // 创建AccessKey ID和AccessKey Secret,请参考https://help.aliyun.com/document_detail/175144.html
            // 如果您使用的是RAM用户的AccessKey,还需要为子账号授予权限AliyunVIAPIFullAccess,请参考https://help.aliyun.com/document_detail/145025.html
            // 从环境变量读取配置的AccessKey ID和AccessKey Secret。运行代码示例前必须先配置环境变量。
            AlibabaCloud.SDK.Videoseg20200320.Client client = CreateClient(System.Environment.GetEnvironmentVariable("ALIBABA_CLOUD_ACCESS_KEY_ID"), System.Environment.GetEnvironmentVariable("ALIBABA_CLOUD_ACCESS_KEY_SECRET"));
            AlibabaCloud.SDK.Videoseg20200320.Models.SegmentVideoBodyAdvanceRequest segmentVideoBodyAdvanceRequest = new AlibabaCloud.SDK.Videoseg20200320.Models.SegmentVideoBodyAdvanceRequest
            ();
            // 场景一,使用本地文件
            //System.IO.StreamReader file = new System.IO.StreamReader(@"/tmp/SegmentVideoBody1.mp4");
            //segmentVideoBodyAdvanceRequest.VideoUrlObject = file.BaseStream;

            // 场景二,使用任意可访问的url
            HttpWebRequest request = (HttpWebRequest)WebRequest.Create("https://viapi-test-bj.oss-cn-beijing.aliyuncs.com/viapi-3.0domepic/videoseg/SegmentVideoBody/SegmentVideoBody1.mp4");
            WebResponse response = request.GetResponse();
            Stream stream = response.GetResponseStream();
            segmentVideoBodyAdvanceRequest.VideoUrlObject = stream;

            AlibabaCloud.TeaUtil.Models.RuntimeOptions runtime = new AlibabaCloud.TeaUtil.Models.RuntimeOptions();
            try
            {
                AlibabaCloud.SDK.Videoseg20200320.Models.SegmentVideoBodyResponse segmentVideoBodyResponse = client.SegmentVideoBodyAdvance(segmentVideoBodyAdvanceRequest, runtime);
                // 获取整体结果
                Console.WriteLine(AlibabaCloud.TeaUtil.Common.ToJSONString(segmentVideoBodyResponse.Body));
                // 获取单个字段
                Console.WriteLine(AlibabaCloud.TeaUtil.Common.ToJSONString(segmentVideoBodyResponse.Body.Data));
            }
            catch (TeaException error)
            {
                // 如有需要,请打印 error
                AlibabaCloud.TeaUtil.Common.AssertAsString(error.Message);
            }
            catch (Exception _error)
            {
                TeaException error = new TeaException(new Dictionary<string, object>
                {
                    { "message", _error.Message }
                });
                // 如有需要,请打印 error
                Console.WriteLine(error.Message);
            }
        }
    }
}

常见的结果后处理

Mask视频融合

调用视频人像分割能够获取分割之后的Mask视频,该视频可以与另一张图片进行背景融合,实现人像的分割。

  1. 安装相关依赖,实现依赖OpenCV。更多信息,请参见OpenCV

    pip install opencv-python
  2. 将分割后的视频下载到本地,与原视频和背景图一起放到data文件夹下。

    背景图:

    image

    相关代码如下:

    import cv2
    import numpy as np
    
    #原视频路径
    video_root = './data/video.mp4'
    #调用视频人像分割返回的结果本地视频路径
    mask_root = './data/mask.mp4'
    video = cv2.VideoCapture(video_root)
    mask = cv2.VideoCapture(mask_root)
    rval, frame = video.read()
    rval_mask, frame_mask = mask.read()
    fps = video.get(cv2.CAP_PROP_FPS)
    h, w = frame.shape[:2]
    fourcc = cv2.VideoWriter_fourcc(*'mp4v')
    video_writer = cv2.VideoWriter('com.mp4', fourcc, fps, (w, h))
    num_frame = video.get(cv2.CAP_PROP_FRAME_COUNT)
    
    #背景图路径
    background_root = './data/img.jpg'
    background = cv2.imread(background_root)
    background = cv2.resize(background, (w, h))
    for c in range(0,int(num_frame)):
            if (frame is None) or (frame_mask is None):
                    continue
            fg_com = frame * (frame_mask/255) + background * (1-frame_mask/255)
            video_writer.write(fg_com.astype(np.uint8))
            rval, frame = video.read()
            rval_mask, frame_mask = mask.read()
    video_writer.release()

    效果视频:

    视频人像分割后得到的视频人像和背景融合的相关代码,请参见com_back

    说明

    代码解压后运行python com_back.py即可,目前示例代码中的背景图三通道的图都可以进行融合。