Online editing

Video editing project

Intelligent Production allows you to edit live streams and recorded files.

1. Click the Video Editing Projects tab.

2. Click Create Editing Project, enter a project name, and then click OK.

3. In the Operation column of the project, click Clip to open the standard editing project interface.

Live stream editing project

1. Click the Live Editing Project tab.

2. Click Create Live Editing Project, configure the required parameters for the live stream editing project, and then click OK.

   Parameter	Description
   Live stream editing name	A custom name for the live stream editing project. The name can contain letters, digits, spaces, and underscores (_) and cannot exceed 60 characters.
   Live stream URL	Enter the URL of the Alibaba Cloud live stream that you want to edit. For information about how to obtain a live stream URL, see Generate live stream URLs. Currently, only HLS (m3u8) streams over HTTPS are supported. Note To edit a live stream, you must first enable live stream recording. For more information, see Record and store to OSS and Record and store to VOD.
   Storage method	Configure the storage destination for the generated live stream clips. Supported destinations are Object Storage Service (OSS) and ApsaraVideo VOD.
   Storage address	You can add ApsaraVideo VOD buckets and your own OSS buckets that are added to the ApsaraVideo VOD system. If no buckets are available, you can create a bucket in the ApsaraVideo VOD console. ApsaraVideo VOD assigns a storage address to each storage region. After you activate ApsaraVideo VOD, you must enable this address before using it. For more information, see Manage storage buckets. You can add Object Storage Service (OSS) buckets. If no buckets are available, you can create a bucket in the OSS console. For more information, see Create buckets.
   Start time	Select a start time for the live stream editing. You can choose to Start or Start from Reserved Time. Before the live stream starts, you can modify the schedule in the online editing list. After the live stream starts, recording begins automatically, and you can edit the stream in real time.

3. In the Operation column of the project, click View to open the live stream editing interface. For more information about live stream editing, see Editing features.

Advanced template editing project

1. Click the Advanced Editing Project tab.

2. Click Create Editing Project, and then click OK to go to the Advanced Templates page.

3. In the Operation column of the template, click Use Template. Enter a project name, and then click OK to open the advanced template editing interface. For details about advanced template editing, see Editing features.

Video editing

1. Open the video editing project interface.

   The video editing project interface is divided into four main areas: the Asset area in the upper-left for managing imported media assets, the central Preview area for real-time video playback, the Property area on the right for adjusting asset parameters, and the Editing area at the bottom, which provides a multi-track timeline for editing operations.

   Number	Description
   ①	Asset area
   ②	Preview area
   ③	Property area
   ④	Editing area

2. Import assets.

   In the upper-right corner of the asset area, click Import to open the media library for the current region. Select the required assets.

   In the media library, you can filter assets by All, Video, Audio, or Image categories. You can also use the search box at the top to search for assets by name.

   If the asset you need is not in the media library, you can upload it. For more information, see Upload media assets in the console.

3. Add assets to the editing area.

   Click the icon on an asset or drag the asset to a track in the editing area.

   You can also add public resources such as Stickers, Filters, and Effects to create multi-track projects and preview the results in real time.

4. Edit assets.

   • Trim, preview, or adjust asset properties

     Select an asset on a track in the editing area. Use the tools in the upper-left corner of the editing area to perform operations such as trimming or deleting. In the preview area, you can preview, drag, scale, and reposition the asset. In the property area, you can adjust its properties.

   • Add a transition effect

     In the editing area, select the video or image where you want to add a transition. In the asset area, click Transitions and select a transition effect, such as a vortex. You can view the effect in the preview area.

   • Smart generate subtitles

     Select a video in the editing area. On the Basic tab in the property area, click Intelligent Subtitling. The generated subtitles are automatically loaded onto a new track.

   • Display the audio waveform for a video

     Select a video in the editing area. Click the icon to select the type of waveform to display. The corresponding waveform is displayed below the video on the track.

   • Smart dubbing

     In the editing area, select the subtitle for which you want to generate a voiceover. Click the icon to set the voice type, and then click Smart dubbing. The generated voiceover is automatically loaded onto a new track.

     Note

     If the message "Please configure the storage path first" appears, you must configure a storage path. For more information, see Configure a storage address.

   • Add markers or mark clips

     In the editing area, select a video and drag the timeline to a specific position. Click the icon to add a marker. Click the or icons to add in and out points for a clip. You can also click the and icons, or the markers and clips above the video on the track, to view their details.

   • Separate an audio track from a video

     Select a video in the editing area. On the Basic tab in the property area, click Separate audio track. The separated audio track is automatically loaded onto a new track.

   • Customize a digital human (Public preview)

     During the public preview, Intelligent Production provides four official digital humans for free trial. You can add a text-driven or voice-driven digital human from the asset area, configure its parameters as needed, and then click Initiate Digital Human and Generate Video. The digital human is added to the video track after synthesis is complete.

     The quality of the official digital humans may not be optimal because they are not trained on real human data. For higher quality requirements, you can join the DingTalk group (ID: 84650000851) to try the professional version of the digital human feature.

     The left-side panel in the asset area displays a list of available digital humans. Select one to preview its appearance in the preview area.

5. After you finish editing, click Save in the upper-right corner to save the project.

   You can also click Generate as Template or Export Video in the upper-right corner to generate a template from the project or export the video to the media library.

Live stream editing

1. Open the live stream editing project interface.

   The live stream editing interface is divided into four areas: the Live signal source area on the left for viewing the live stream, the central Video preview area for previewing edited content, the Editing area at the bottom with a timeline for creating clips, and the Clip list area on the right for managing generated video clips.

   Number	Description
   ①	Live signal source area
   ②	Video preview area
   ③	Editing area
   ④	Clip list area

2. Split the video into clips.

   In the upper-left corner of the editing area, click the or icon. Then, press and hold the left mouse button to adjust the clip duration, and click Generate Clip. The generated clip is automatically saved and appears in the clip list area.

   You can also click the icon to undo the last action or click Preview Clip to preview a clip.

3. Edit video clips.

   In the clip list area, select a video clip and click Export To Video Editing in the upper-right corner to perform further edits. For more information, see Editing features.

Advanced template editing

1. Open the advanced template editing project interface.

   The advanced template editing interface is divided into three areas: the central Video preview area for real-time preview of the template effect, the Editing group list area at the bottom that displays the editing groups in the template, and the Editing group asset area on the right for replacing and editing the assets in the current group.

   Number	Description
   ①	Video preview area
   ②	Editing group list area
   ③	Editing group asset area

2. In the editing group list area, click a specific editing group to replace its assets.

   • Replace video or image assets.

     In the editing group asset area, click a video or image, and then click Replace Asset. The media library for the current region opens. Select a replacement asset.

     If the asset you need is not in the media library, you can upload it. For more information, see Upload media assets in the console.

   • Replace text assets.

     Edit the text in the preview area or set the text properties in the editing group asset area.

     When you select a text asset, a yellow editing border appears in the preview area. You can drag this border to adjust the asset's position and size. The property panel on the right allows you to configure text content, font size, color, and position.

3. Optional: Preview the video.

   In the editing group list area, click the icon to preview the video.

   Note

   If you modify an editing group, the service regenerates the preview video, which incurs Online Editing and storage fees. For billing details, see Intelligent Production and Storage fees.

4. Produce the video.

   In the upper-right corner, click Export Video. Configure the export parameters as required, and then click OK.

Video editing

Video editing is the process of combining multiple assets, such as video clips, audio, and images, on a timeline to generate a new video file.

API reference

• Submit a media producing job: Call the SubmitMediaProducingJob API to combine one or more video, audio, image, and subtitle assets into a final product. This API supports complex timeline configurations to meet diverse editing requirements.

• Query a media producing job: Call the GetMediaProducingJob API and pass the JobId to retrieve the job status and results.

Timeline configuration

The core of video editing is the timeline configuration, which defines the editing logic. A timeline defines how assets like video, audio, and images are arranged and combined over time. It primarily consists of tracks, assets, and effects. For detailed configuration instructions, see timeline configuration details.

Basic timeline structure

{
  "VideoTracks": [
    {
      "VideoTrackClip": [
        {
          "MediaId": "The asset ID.",
          "MediaURL":"The OSS URL of the clip."
        }
      ]
    }
  ],
  "AudioTracks": [
    {
      "AudioTrackClip": [
        {
          "MediaId": "The audio asset ID.",
          "MediaURL":"The OSS URL of the clip."
        }
      ]
    }
  ]
}

• VideoTracks: Video tracks used to place video or image assets.

• AudioTracks: Audio tracks used to place audio assets.

• Clips: The segments within each track, containing the asset ID, start time, and duration.

Timeline examples

The following table lists common use cases and links to configuration examples that demonstrate how to perform complex video edits by using timeline configurations.

Audio and video editing with the SDK

Install and configure the Intelligent Media Services (IMS) server-side SDK. For more information, see Prerequisites.

Live stream editing

• Submit a live stream editing job: Call the SubmitLiveEditingJob API. After submission, the job is queued for asynchronous execution.

• Query a live stream editing job: Call the GetLiveEditingJob API to query the job status based on the jobId.

• Get media asset information: Call the GetMediaInfo API to query information about a generated media asset based on its MediaId.

Advanced template editing

1. Retrieve template information.

   Call the GetTemplate operation and set the TemplateId parameter to retrieve the template information.

   GetTemplateRequest request = new GetTemplateRequest();
   request.setTemplateId("****20b48fb04483915d4f2cd8ac****");
   GetTemplateResponse response = iceClient.getTemplate(request);
   GetTemplateResponseBody.GetTemplateResponseBodyTemplate template = response.getBody().getTemplate();
   System.out.println("templateId : " + template.getTemplateId());
   System.out.println("clipsParam : " + template.getClipsParam());

   The following example shows a sample response:

   {
       "RequestId":"******11-DB8D-4A9A-875B-275798******",
       "Template":{
           "TemplateId":"****20b48fb04483915d4f2cd8ac****",
           "Name":"AdvancedTemplateTest",
           "Type":"VETemplate",
           "Status":"Available",
           "ModifiedSource":"OpenAPI",
           "CreateSource":"OpenAPI",
           "Config":"{\"oss_url\":\"http://your-bucket.oss-cn-shanghai.aliyuncs.com/object.zip\"}",
           "ClipsParam":"{\"Text7\":\"text\",\"Text6\":\"text\",\"Text5\":\"text\",\"Text4\":\"text\",\"Text3\":\"text\",\"Text2\":\"text\",\"Text1\":\"text\",\"Text0\":\"text\",\"Media3\":\"mediaId\",\"Media2\":\"mediaId\",\"Media1\":\"mediaId\",\"Media0\":\"mediaId\"}",
           "PreviewMedia":"",
           "CoverURL":""
       }
   }

   Note

   You can also use system-provided templates. The procedure is similar to using a custom template. For more information about system-provided templates, see Public template library - Advanced templates.

2. As required, replace the text and mediaId fields in the ClipsParam parameter that was returned in the previous step.

   {
       "Text0":"Caption0",
       "Text1":"Caption1",
       "Text2":"Caption2",
       "Text3":"Caption3",
       "Text4":"Caption4",
       "Text5":"Caption5",
       "Text6":"Caption6",
       "Text7":"Caption7",
       "Media0":"****20b48fb04483915d4f2cd8ac****",
       "Media1":"****20b48fb04483915d4f2cd8ac****",
       "Media2":"****20b48fb04483915d4f2cd8ac****",
       "Media3":"****20b48fb04483915d4f2cd8ac****"
   }

   Note

   • ClipsParam is a parameter for the production service. You can replace `text` with your text content and `mediaId` with a media asset ID or its OSS URL. Videos and images are supported. You can use a combination of IDs and URLs.

   • If you set only some fields in the ClipsParam parameter, unspecified captions are empty by default, and unspecified media assets default to the original assets in the template.

   • You can set fonts for captions and adaptation modes for videos and images. For more information, see Extended features.

3. You can call the synthesis service.

   Call the SubmitMediaProducingJob operation to submit a video editing and production job. Set the TemplateId and ClipsParam parameters.

   SubmitMediaProducingJobRequest request = new SubmitMediaProducingJobRequest();
   request.setTemplateId("****20b48fb04483915d4f2cd8ac****");
   request.setClipsParam("{\"Text7\":\"Caption7\",\"Text6\":\"Caption6\",\"Text5\":\"Caption5\",\"Text4\":\"Caption4\",\"Text3\":\"Caption3\",\"Text2\":\"Caption2\",\"Text1\":\"Caption1\",\"Text0\":\"Caption0\",\"Media3\":\"****20b48fb04483915d4f2cd8ac****\",\"Media2\":\"****20b48fb04483915d4f2cd8ac****\",\"Media1\":\"****20b48fb04483915d4f2cd8ac****\",\"Media0\":\"****20b48fb04483915d4f2cd8ac****\"}");
   request.setOutputMediaConfig("{\"MediaURL\":\"http://your-bucket.oss-cn-shanghai.aliyuncs.com/object.mp4\"}");
   SubmitMediaProducingJobResponse response = iceClient.submitMediaProducingJob(request);
   System.out.println("jobid : " + response.getBody().getJobId());