Detect and locate elements

更新时间:
复制 MD 格式

Detects elements in an input image. It annotates the position of each element with a rectangular box and identifies its basic type, such as person/object, decoration, or text.

Introduction

  • Name: Detect and Locate Elements

  • Action: DetectImageElements

Example image:

Parameters

Input fields:

Field

Type

Required

Description

url

string

Yes

The URL of the image.

Output fields:

Field

Type

Required

Description

elements

List<element>

Yes

A list of elements.

Element definition

Field

Type

Required

Description

score

float

Yes

The prediction score. The value is between 0.0 and 1.0.

x

int

Yes

The x-coordinate of the top-left corner of the element.

y

int

Yes

The y-coordinate of the top-left corner of the element.

width

int

Yes

The width of the element.

height

int

Yes

The height of the element.

type

string

Yes

The type of the element.

Element type definitions:

   UnType("Undefined type"),
    AllType("All types"),
    RootType("Root type"),
    Synthesis("Composite element"),
    Embedded("All nested types"),
    Format("Element format"),
    MajorObject("Main entity"),
    Character("Text"),
    Identifier("Identifier"),
    Background("Background"),
    Decoration("Decoration"),
    MajorHuman("Human model"),
    MajorAuction("Product"),
    MajorThing("Object"),
    MajorOther("Other main entity"),
    CharMain("Main text"),
    CharSub("Sub text"),
    CharAction("Call-to-action text"),
    CharContent("Content text"),
    CharNumber("Numeric text"),
    CharOther("Other text"),
    IdentLogo("Logo identifier"),
    IdentLight("Highlight identifier"),
    IdentCode("Code identifier"),
    IdentOther("Other identifier"),
    BackBitmap("Bitmap background"),
    BackVector("Vector graphic background"),
    BackOther("Other background"),
    DecoTile("Tiled decoration"),
    DecoRegion("Area decoration"),
    DecoPieces("Fragment decoration"),
    DecoEdge("Edge decoration"),
    DecoLine("Line decoration"),
    DecoBox("Box decoration"),
    DecoChar("Call-to-action text decoration"),
    DecoOther("Other decoration"),
    SynthMajor("Main entity group"),
    SynthChar("Text group"),
    SynthIdent("Identifier group"),
    SynthBack("Background group"),
    SynthDeco("Decoration group"),
    SynthOther("Other group"),
    EmbedSvg("Embedded SVG format"),
    EmbedJson("Embedded JSON format"),
    EmbedHtml("Embedded HTML format")

Example:

Input

{
   "url": "http://ivpd-demo.oss-cn-shanghai.aliyuncs.com/ivpd-demo/images/DetectImageElements/detect-elements-src.png"
}

Output

{
  code: "0",
  message: "success",
  trackId: "0b0ab09d15627518578475681e",
  reqeustId: "0b0ab09d15627518578475681e",
  data: {
    elements:[
        {
          "score": 0.997582077980042,
          "width": 83,
          "height": 24,
          "x": 246,
          "x": 262,
          "type": "character"
        },
        {
          "score": 0.96921968460083,
          "width": 277,
          "height": 259,
          "x": 588,
          "x": 66,
          "type": "majorhuman"
        }
    ]
    }
}