The Annotation Center provides real-time annotation for user session logs. The system supports clustering of similar user questions to significantly reduce annotation costs. You can use the clustering switch to enable or disable this feature. You can then annotate the data based on the match results.
Pending annotation tasks
By default, the system lists data from the current month that is pending annotation. You can also specify a custom data range using the following options:
Match type: Select one or both of the following match types: No answer and FAQ recommendation.
Bot: Select an active bot from Bot Management.
Update time: Filter data based on the update time. The default range is the current month.
Answer perspective: Select one or more answer perspectives. You can configure these perspectives in the advanced options.
Keyword: Filter user questions by keyword.
Question clustering
This feature is enabled by default. When this feature is enabled, all pending annotation data is displayed in clusters. You can click a category in the list on the left to view the corresponding user questions on the right.
If you disable this feature, the system lists all pending annotation data individually. You must click Load more at the bottom of the list to load more data.
Data annotation
In the user question list, determine whether a user question matches the actual hit. You can use the buttons to annotate or adjust the match. Data that is correctly annotated or adjusted is moved to the Annotated tab. Other data is moved to the Ignored or Pending tabs for later annotation. You can also press the Shift key to select multiple items for batch operations.
Correct
When you click Correct, the pending data is moved to the Annotated tab. This action completes the annotation for the current user utterance.
Adjust
When you click Adjust, a window opens. In this window, you can select a new match object. The system supports two types of match objects: FAQ and Dialog Studio.
FAQ: After you select FAQ, you can search for FAQ categories. Select a category on the left to display the corresponding FAQ information on the right. Click Details to open a preview window that contains the FAQ details. Select the correct FAQ and click OK to complete the annotation. The system then adds the current user utterance to the list of similar questions for that FAQ.
Dialog Studio: After you select Dialog Studio, you can select the relevant bot. When you select a bot, all of its intents are listed. Select the correct intent and click Confirm to complete the annotation. The system then adds the current user utterance to the list of user utterances for that intent.
Ignore
When you click Ignore, the pending data is moved to the Ignored tab. In the Ignored tab, you can still perform the Correct or Adjust operations on the ignored user utterances.
Pending
When you click Pending, the pending data is moved to the Pending tab. In the Pending tab, you can perform the Correct, Adjust, or Ignore operations on the user utterances.