Configure an incremental scan task

更新时间:
复制 MD 格式

This topic describes how to configure an incremental scan, which automatically detects policy violations in new images and videos added to a specified Object Storage Service (OSS) bucket. After the scan, you can view the results and statistics.

Background

For information about the limitations of OSS Violation Detection, such as supported OSS buckets, detection scenarios, and file formats, see Limitations.

Prerequisites

Step 1: Configure an incremental scan task

  1. Log on to the Content Moderation console.

  2. In the left-side navigation pane, choose OSS Violation Detection V1.0 > Settings.

  3. On the Incremental Scan tab, follow the wizard to complete the configuration:

    1. Select buckets.

      In the Available pane on the left, select the buckets to scan, add them to the Selected pane on the right, and then click Next.

    2. Set filter conditions.

      Filter or Exclude: By default, all files in the selected bucket are scanned. If you need to specify which files in the bucket to scan or exclude, you can click Set Filter Conditions to the right of the bucket. In the Filter Conditions dialog box, configure the filter conditions as prompted, and then click OK.

      Table 1. Filter condition parameters
      ParameterDescription
      Filter conditionSelect Include to scan only the specified paths or Exclude to skip the specified paths.

      PathEnter the path to include or exclude.

      Click Add to specify multiple paths. You can add up to 10 paths.

      Example (using Include):
      • If you add the prefix img/test_img/test_, only files in the bucket with this prefix are scanned.
      • To scan files in a specific directory, you can add the directory path as part of the prefix. For example, to scan files with the prefix test_ in the img/202011 directory, add img/202011/test_ as the path.
    3. Configure detection scenarios.
      OSS Violation Detection provides eight recommended configurations. Each configuration includes primary scenarios (image, video, and audio) and different sub-scenarios. If these presets do not fit your needs, you can enable or disable the primary scenarios (image, video, audio), but the sub-scenarios cannot be changed.

      Then, click Next.

    4. Configure scan scope.

      The available scan scope options depend on your selected detection scenarios. For example, if you select only Image on the Scenario Configuration page, the Scan configuration page shows only settings for images. You can customize the scan scope if the default settings do not meet your requirements.

      Note

      You must select at least one detection scenario (image, video, or audio) for scanning.

      Table 2. Scan configuration parameters

      Scan scope

      Parameter

      Description

      Image

      Daily image scan limit

      The maximum number of images scanned per day. The default value is 10,000. Once the limit is reached, scanning stops for the day. This can leave non-compliant images undetected, so we recommend not setting a limit.

      Detect files without suffixes

      When Detect files without suffixes is enabled, the service scans image files without an extension by identifying them as images based on their HTTP content-type header. This might reduce detection speed. Supported content types include image/jpg, image/jpeg, image/png, image/gif, image/bmp, and image/webp.

      Video

      Daily video scan limit

      The maximum number of videos scanned per day. The default value is 1,000. Once the limit is reached, scanning stops for the day. This can leave non-compliant videos undetected, so we recommend not setting a limit.

      Frame capture frequency

      The default frequency is 1 frame per second. You can set the interval in seconds between frame captures. Valid values: 1 to 60. A higher frequency improves detection accuracy.

      Single video frame limit

      The maximum number of frames that can be captured from a single video. The default value is 200. Valid values: 5 to 20,000.

      Single video size limit

      The maximum size of a single video. The default value is 500 MB. You can set a value from 1 MB to 2,048 MB. Data exceeding this limit is not scanned.

      For example, if a 600 MB video is scanned with the default 500 MB limit, only the first 500 MB is scanned.

      Audio

      Daily audio scan limit

      The maximum number of audio files scanned per day. The default value is 1,000. Once the limit is reached, scanning stops for the day. This can leave non-compliant audio files undetected, so we recommend not setting a limit.

      Single audio size limit

      The maximum size of a single audio file. The default value is 200 MB. You can set a value from 1 MB to 2,048 MB. Data exceeding this limit is not scanned.

      For example, if a 300 MB audio file is scanned with the default 200 MB limit, only the first 200 MB is scanned.

      Then, click Next.

    5. Optional:Others. In the Callback Notification section, you can select an existing callback notification plan to receive scan results.

      To select a callback notification plan, you must first create one. If needed, click Add Notification Plan to create a new plan. For more information, see Configure message notifications.

  4. Read and select I have read and agreed to the OSS Violation Detection Terms of Service, and then click Save.

    OSS Violation Detection estimates the maximum scanning cost based on your configuration. You can choose either the pay-as-you-go or resource plan billing method.

    Then, click OK.

    The configuration takes effect immediately upon saving. The system then automatically scans new content in the selected buckets based on your settings. You can view the task status in the incremental scan task list.

Step 2: View scan results

After an incremental scan is complete, you can view the results and perform a manual review in the Content Moderation console.

  1. On the Incremental Scan page, view the Task overview, Task Status, and Task results.

  2. In the Actions column, click Scan Result to view scan results and perform a manual review.

    By default, the scan results and handled violations from the last 7 days are displayed. You can filter the results by setting File Type, Detection scenario, Bucket, Score, Detection Result, Key, and Time Range.

    Click Export to export the scan results. If there are fewer than 50 records, all results are exported. Otherwise, only the results for violative and suspected content are exported.

    Note

    Click an image or video in the scan results to view its Details, including the file creation time, key (the OSS object name), and its bucket.

    If a scan result is incorrect, you can manually reclassify it. The following actions are available:

    • Mark as Violation and Delete

      Click Mark as Violation and Delete to delete the image or video from both the Content Moderation console and the OSS bucket. You can select one or more items.

    • Mark as Normal and Ignore

      Click Mark as Normal and Ignore to dismiss the detection result. After you ignore an item, it is no longer displayed in the console. This action does not affect the file stored in the OSS bucket. You can select one or more items.

    • Mark as Normal and Unfreeze

      If you have enabled the automatic freeze feature, you can select a frozen image or video and click Mark as Normal and Unfreeze to unfreeze it.

Step 3: View statistics

OSS Violation Detection provides a statistics feature. After an incremental scan task is complete, you can view statistical information in the Content Moderation console at any time. By monitoring statistics over a period, you can adjust your website's content policies based on violation trends.

  1. On the Incremental Scan page, find the task, click the image.png icon in the Actions column, and then click Statistics.

  2. On the Statistics page, click the Image, Video, or Audio tab to view scan statistics for the last 7 days.

    The following table describes the available statistics.

    Query object

    Statistics

    Image

    • Total number of images: The total number of scanned images.

    • Pornography detection volume: The number of violating, suspected, and normal results.

    • Terrorism and politically sensitive content detection volume: The number of violating, suspected, and normal results.

    • Spam detection volume: The number of violating, suspected, and normal results.

    • Adulteration detection volume: The number of violating, suspected, and normal results.

    Video

    • Total number of videos: The total number of scanned videos.

    • Total number of video frames: The total number of captured video frames.

    • Pornography detection volume: The number of violating, suspected, and normal results.

    • Terrorism and politically sensitive content detection volume: The number of violating, suspected, and normal results.

    • Spam detection volume: The number of violating, suspected, and normal results.

    • Adulteration detection volume: The number of violating, suspected, and normal results.

    • Audio spam detection volume: The number of violating, suspected, and normal results.

    Audio

    • Total number of audio files: The total number of scanned audio files.

    • Total duration of audio files: The total duration of scanned audio files.

    • Audio spam detection volume: The number of violating, suspected, and normal results.

Other operations

OSS Violation Detection provides the following task management options:

  • Stop scanning

    If you no longer need to scan the current task, click Stop scanning in the Actions column.

  • Reset

    To change the settings for a task, click Reset in the Actions column.

  • View configuration

    To view a task's configuration details, click the image.png icon in the Actions column and select View configuration.

  • Dosage instructions

    To view usage details for a task, click the image.png icon in the Actions column and select Dosage instructions.