The Intelligent Scoring template helps you rewrite question and answer content, configure questions for each annotation item, and quickly generate high-quality answers. Use pre-annotation to intelligently assign content for annotation.
Data format example
In CSV and XLSX formats, each data column corresponds to a dataset field. In the manifest format, each field nested under the data field corresponds to a dataset field. The Field Name is customizable and can be selected during configuration.
In the Item area dataset, the role and value field names cannot be changed. The position and Name of the values prompt and reply for the role field are also fixed. However, the value of the value field can be modified. Refer to the following example for the format of questions. If you do not need questions, keep only the corresponding item fields.
CSV and XLSX formats
Item | Questions |
[{ "role": "prompt", "value": "Describe a work of art with the theme of 'mental science'.", "index": 4510 }, { "role": "reply", "ModelID": "13b.17f2-v10.15.2", "key": "Answer1", "value": "I am sorry, but as a language model, I cannot create works of art. However, I can provide some information about artworks themed around 'mental science'.\n\nIn modern art, many artists have explored the theme of mental science in forms such as painting, sculpture, photography, installation art, and performance art. Here are a few possible examples:\n\n1. Antony Gormley's painting 'Blue Angel', which is themed on schizophrenia. The figure in the painting is vividly depicted, showing their inner struggle and conflict.\n\n2. Peter Lindbergh's photograph 'Untitled', a very famous photo showing the back of a person lying in bed, looking very lonely and helpless. This photo can raise audience awareness and understanding of mental illness.\n\n3. Julia Roberts' sculpture 'Untitled', which is a very simple piece but conveys a profound sense of understanding and concern for mental illness.\n\n4. Damien Hirst's performance piece 'Wavelength', a musical performance that explores the impact of mental illness on human thought and emotion. The combination of music, lighting, and dance allows the audience to feel the artist's deep understanding of this theme.\n\nThese are just some possible examples, and artists can express their exploration and understanding of mental science in their own ways." }] | [{ "title": "Question 2", "type": "Cascader", "renderProps": { "options": [{ "children": [{ "children": null, "label": "Sub-option 2.1.1", "value": "Sub-option 2.1.1", "key": "Sub-option 2.1.1" }, { "children": null, "label": "Sub-option 2.1.2", "value": "Sub-option 2.1.2", "key": "Sub-option 2.1.2" }], "label": "Option 2.1", "key": "Option 2.1", "value": "Option 2.1" }, { "children": [{ "children": null, "label": "Sub-option 2.2.1", "value": "Sub-option 2.2.1", "key": "Sub-option 2.2.1" }, { "children": null, "label": "Sub-option 2.2.2", "value": "Sub-option 2.2.2", "key": "Sub-option 2.2.2" }], "label": "Option 2.2", "key": "Option 2.2", "value": "Option 2.2" }], "required": false } }, { "title": "Question 1", "type": "Checkbox", "renderProps": { "options": [{ "label": "Option 1.1", "key": "Option 1.1", "value": "Option 1.1" }, { "label": "Option 1.2", "key": "Option 1.2", "value": "Option 1.2" }], "required": true } }, { "title": "Question 3", "type": "Input", "renderProps": { "options": null, "required": true } }] |
Sample file: Scoring V2 - Dataset CSV Version.csv
Manifest format (JSONL)
Sample file: [iTAG] Intelligent Scoring demo.manifest
Configuration
Item area (required)
Use the Item area to configure the question and answer text.
Select the Item area, choose the corresponding dataset, and then configure the parameters in the Configuration panel on the right. The following table describes the parameters.
Parameter | Description |
Title | Do not modify the default title. |
Dataset Field | Select the dataset field that contains the question and answer text. The field name can be customized. |
Note | Do not modify the default prompt. |
Click the link | This parameter has no effect. |
Text Highlight | This parameter has no effect. |
Card Style Configuration | This parameter has no effect. |
Questions area (optional)
Use the Questions area to configure questions for each question-and-answer item. If item-specific questions are not needed, you can remove this section by clicking the delete icon in the upper-right corner.
Select the Questions area, choose the corresponding dataset, and then configure the parameters in the Configuration panel on the right. The following table describes the parameters.
Parameter | Description |
Title | Do not modify the default title. |
Dataset Field | Select the dataset field that contains the questions corresponding to the question and answer text. The field name can be customized. |
Note | Do not modify the default prompt. |
Click the link | This parameter has no effect. |
Text Highlight | This parameter has no effect. |
Card Style Configuration | This parameter has no effect. |
Global questions (optional)
Use Global Questions to add questions that apply to the entire topic.
After adding a question, configure its parameters in the Configuration panel on the right. The following table describes the parameters.
Parameter | Description |
Title | Set the question title. |
Placeholder Text Note This parameter is required when the answer type is Input Field or Input Field-Markdown Preview. | Placeholder text to guide user input. |
Option Note This parameter is required when the answer type is Single choice, Multiple choice, Tree-like Choices, or Multi-choice Tree. |
|
Note | The text to display in a tooltip when a user hovers over the question title. |
Required | Specifies whether the question is required. If enabled, the system validates that an answer is provided. |
Support Search for Options Note This parameter is available when the answer type is Single choice or Multiple choice. | Adds a search bar to filter options. |
Effective Period | Specifies the workflow stage in which the question is active. If no stage is selected, it defaults to the entire workflow. |
Demonstration
You can edit or expand the prompt and reply areas, and answer questions in the Questions area and the Global Questions area.
