Performance issues

• Why is normal text identified as abusive content? Why is abusive content not detected?
• Why is normal text identified as pornographic content? Why is pornographic content not detected?
• Why are keywords such as QR codes not detected during text moderation?
• Why are pornographic images not detected during image moderation?
• Why are whitelisted keywords still blocked?
• Why are images with national flags and emblems not blocked?
• How do I handle medical images of human bodies that are identified as pornographic?

Why is normal text identified as abusive content? Why is abusive content not detected?

Abusive text is classified into three severity categories: severe abuse, minor abuse, and profanity. Adjust the machine-assisted moderation rules for text in the console to fit your scenario. If specific text is not detected or is misidentified, add it to a custom similar text library or keyword library, and then use an ignore list or a review list to resolve the issue.

For more information, see Customize machine-assisted moderation rules and Manage custom text libraries.

Why is normal text identified as pornographic content? Why is pornographic content not detected?

Pornographic text is classified into three severity categories: severe pornography, vulgar content, and sexual knowledge. Adjust the machine-assisted moderation rules for text in the console to fit your scenario. If specific text is not detected or is misidentified, add it to a custom similar text library or keyword library, and then use an ignore list or a whitelist to resolve the issue.

For more information, see Customize machine-assisted moderation rules and Manage custom text libraries.

Why are keywords such as QR codes not detected during text moderation?

The text advertisement detection scenario detects content such as phone numbers, WeChat, QQ, URLs, and ad slogans. Adjust the machine-assisted moderation rules for text in the console to suit your scenario. If specific text is not detected, add it to a custom similar text library or keyword library, and then use a blacklist or a review list to resolve the issue.

For more information, see Customize machine-assisted moderation rules and Manage custom text libraries.

Why are pornographic images not detected during image moderation?

The pornography detection scenario classifies images into three categories based on explicitness: explicit pornography, vulgarity, and suggestive exposure. Adjust the machine-assisted moderation rules for images in the console. If a specific image is not detected, add it to a custom image library, select the pornography detection scenario, and then use a blacklist or a review list to resolve the issue.

For more information, see Customize machine-assisted moderation rules and Manage custom text libraries.

Why are whitelisted keywords still blocked?

A custom text library may not take effect for the following reasons:

• It takes about 15 minutes for added keywords to take effect. Try again later.
• Confirm how the text library is used:
  • For content with five or fewer characters, use the Keywords option. Set the matching method to Transform then Match.
  • For content with more than five characters, use the Similar Text option.
• Make sure that the text library is applied to the corresponding business scenario (Biztype).

For more information, see Manage custom text libraries.

Why are images with national flags and emblems not blocked?

AI Guardrails provides several detection scenarios, such as pornography detection, terrorist content, text and image violations, and undesirable scenes. To block content such as national flags and emblems, use the terrorist content detection scenario. This scenario detects several types of content, including people, symbols, weapons, events, religion, official business, and certificates. Adjust the machine-assisted moderation rules for images in the console. In the Symbol Detection category, select the national flag and emblem. You must also specify the terrorist content detection scenario in the AI Guardrails API.

For more information, see Customize machine-assisted moderation rules and Synchronous detection.

How do I handle medical images of human bodies that are identified as pornographic?

The pornography detection feature of AI Guardrails may incorrectly classify medical images as pornographic content. If an image is misclassified, use its data ID (dataId) to perform a manual review. The dataId is returned by the synchronous image detection API and the manual image review API.

For more information, see the synchronous image detection API or the manual image review API.