Instruction list-Alibaba Cloud Model Studio(Model Studio)-阿里云帮助中心

Instructions are tasks issued to a device through multi-modal interaction for execution, such as turning on a desk lamp or increasing the volume.

The multi-modal interaction development suite provides a series of system instructions. You can simply select the instructions you need. The selected instructions are then automatically enabled in conversations and issued to the device.

To modify issued instructions, adjust them on the Settings page.

Screenshot

To provide a model reply when an instruction is issued, select a reply mode on the Settings page:

Reply based on execution status (default): After an instruction is issued, the system waits for a success or failure message from the device. The model then generates a corresponding reply, such as "The air conditioner is set to 26 degrees" or "The volume is already at its maximum and cannot be increased further."
Auto-reply: An automatic reply is sent simultaneously with the instruction.

Screenshot

If you need custom instructions, such as "Open Xiaoyun Radio", use the custom instruction feature. You can configure the issued instruction. By default, it is the same as the instruction name, but you can modify it manually.

Brightness settings

Instruction name	Instruction description	Instruction example	Parameter name	Parameter description	Parameter example
increase_brightness	Increase brightness	Increase brightness by 10	number	Brightness value	Increase brightness by 10\|number=10
increase_brightness	Increase brightness	Increase brightness by 10	to	to, up to, set to, ...	Increase brightness to 10\|to=to
increase_brightness_default	Increase brightness by default	Increase the brightness a bit
decrease_brightness	Decrease brightness	Decrease brightness by 10	number	Brightness value	Decrease brightness by 10\|number=10
decrease_brightness	Decrease brightness	Decrease brightness by 10	to	to, up to, set to, ...	Decrease brightness to 10\|to=to
decrease_brightness_default	Decrease brightness by default	Decrease the brightness a bit
set_brightness	Set brightness	Set brightness to 50	number	Brightness value	Set brightness to 50\|number=50
set_brightness	Set brightness	Set brightness to 50	to	to, up to, set to, ...	Set brightness to 50\|to=to

Volume settings

Instruction name	Instruction description	Instruction example	Parameter name	Parameter description	Parameter example
increase_volume	Increase volume	Increase volume by 10	number	Volume value	Increase volume by 10\|number=10
			to	to, up to, set to, ...	Increase volume to 10\|to=to
			for	Volume category, including the following: System, Media, Call	Increase media volume to 30\|for=Media
increase_volume_default	Increase volume by default	Increase the volume a bit
decrease_volume	Decrease volume	Decrease volume by 10	number	Volume value	Decrease volume by 10\|number=10
			to	to, up to, set to, ...	Decrease volume to 10\|to=to
			for	Volume category, including the following: System, Media, Call	Decrease system volume to 30\|for=System
decrease_volume_default	Decrease volume by default	Decrease the volume a bit
set_volume	Adjust volume	Set volume to 50	number	Volume value	Set volume to 50\|number=50
			to	to, up to, set to, ...	Set volume to 50\|to=to
			for	Volume category, including the following: System, Media, Call	Set call volume to 30\|for=Call
mute	Mute	Mute
unmute	Unmute	Unmute

Device control

Instruction name	Instruction description	Instruction example	Parameter name	Parameter description	Parameter example
shutdown	Shut down	Shut down, turn off the computer
quit	Exit	Exit, talk later, end session, exit voice assistant
back	Back	Go back to the previous level
confirm	Confirm	OK	record	Whether to record	Confirm and record\|record=True
cancel	Cancel	Not necessary
select	Select	Select the second one	index	Serial number	Select the second one\|index=2
check_battery	Check battery	How much battery is left?

Screen control

Instruction name	Instruction description	Instruction example	Parameter name	Parameter description	Parameter example
screen_off	Turn off screen/Standby mode	Turn off the screen, enter standby mode
screen_shot	Take a screenshot	Take a screenshot for me
screen_recording	Record screen	Record the screen for me
stop_screen_recording	Stop screen recording	Stop screen recording

Multimedia control

Instruction name	Instruction description	Instruction example	Parameter name	Parameter description	Parameter example
play	Play (excluding music)	Play podcast, play movie
start_over	Play from the beginning	Play again from the beginning
stop	Pause	Pause playback
resume_play	Resume playback	Resume playback
next	Next	Next song	unit	Unit	Next song\|unit=song
previous	Previous	Previous song	unit	Unit	Previous song\|unit=song
change	Change	Change song	unit	Unit	Change song\|unit=song

Application switch

Instruction name	Instruction description	Instruction example	Parameter name	Parameter description	Parameter example
open_notification	Open notifications	Open notifications
exit_notification	Close notifications	Close notifications
clean_notification	Clear notifications	Clear all notifications
open_photos	Open Photos	Open Photos
quit_photos	Exit Photos	Exit Photos
open_player	Open Multimedia (Bluetooth audio playback control)	Open Multimedia
quit_player	Exit Multimedia	Exit Multimedia
open_app_center	Open App Center	Open App Center
quit_app_center	Exit App Center	Exit App Center
open_Prompter	Open Prompter	Open Prompter
quit_Prompter	Exit Prompter	Exit Prompter
open_app	Open a third-party application	Open WeChat	app_name	Application name, such as: Weibo, NetEase News, Xiaohongshu, Lark, DingTalk;	Open WeChat\|app_name=WeChat
quit_app	Exit a third-party application	Exit WeChat	app_name	Application name	Exit WeChat\|app_name=WeChat
open_setting	Open Settings	Open Settings	type	Settings type, such as: System, General, Display, Volume, Application, Device Connection, Privacy Policy;	Open General Settings\|type=General
quit_setting	Exit Settings	Exit Settings	type	Settings type	Exit General Settings\|type=General
open_system_update	Open System Update	Open the system update page
quit_system_update	Exit System Update	Close the system update page
open_dnd_mode	Turn on Do Not Disturb mode	Turn on Do Not Disturb mode
quit_dnd_mode	Turn off Do Not Disturb mode	Turn off Do Not Disturb mode
open_auto_brightness	Turn on auto-brightness	Turn on light-sensing mode
quit_auto_brightness	Turn off auto-brightness	Turn off auto-brightness
open_vr_calibration	Open VR calibration	Open the VR calibration page
quit_vr_calibration	Exit VR calibration	Close the VR calibration page

Music

Instruction name	Instruction description	Instruction example	Parameter name	Parameter description	Parameter example
play_music	Play music	Play a song	song	Song name	I want to listen to Ten Years\|song=Ten Years
			artist	Artist	I want to listen to a song by Jay Chou\|artist=Jay Chou
			album	Album	I want to listen to the album The Eight Dimensions\|album=The Eight Dimensions
			style	Style/Genre	I want to listen to rock music\|style=rock
			language	Dialect/Language	I want to listen to a Cantonese song\|language=Cantonese
			general_tag	Scenario/Tag	I want to listen to a relaxing song\|general_tag=relaxing
			era	Era	Play a song from the 80s\|era=80s
			sort	Sort, including the following: Latest, Hottest	Play the latest song\|sort=Latest
			music_type	Music type, including the following: Song, Album, Playlist	I want to listen to an album by Andy Lau\|music_type=Album
			media_name	Playback platform	Play a song from Xiami Music\|media_name=Xiami Music
play_daily_playlist	Play daily recommended playlist	Play daily recommended playlist
play_my_collection	Play my favorite playlist	Play my favorite playlist
play_randomly	Recommended for you	Play some random songs
like	Like/Add to favorites	Like this song
unlike	Dislike/Remove from favorites	Dislike this song

Photo and video

Instruction name	Instruction description	Instruction example	Parameter name	Parameter description	Parameter example
take_photo	Take a photo	Take a photo
quick_burst	Burst shot	Take a burst of three photos	number	Number of photos	Take a burst of three photos\|number=3
open_camera	Open camera	Open camera
quit_camera	Exit camera	Exit camera
open_photo_mode	Open photo mode	Open photo mode
quit_photo_mode	Exit photo mode	Close photo mode
open_camera_preview	Open camera preview mode	Open camera preview mode
quit_camera_preview	Close camera preview mode	Close camera preview mode
video_recording	Record video	Record a video
open_video_mode	Open camera mode	Enter Photo mode
quit_video_mode	Exit photography mode	Disable Photography Mode

Making calls

Instruction name	Instruction description	Instruction example	Parameter name	Parameter description	Parameter example
call	Make a call	Make a call	contact_name	Contact name	Call Xiaoming\|contact_name=Xiaoming
			phone_number	Phone number	Dial 10086\|phone_number=10086
			phone_type	Phone type	Call Xiaoming's work phone\|phone_type=Work
			phone_entity	Phone entity	Call the fire department\|phone_entity=Fire department
			record	Whether to record	Call and record\|record=True
confirm	Confirm	OK	record	Whether to record	Confirm and record\|record=True
cancel	Cancel	No, thanks
open_call	Open Phone	Open the Phone application
quit_call	End Call	Exit the Phone application
answer_call	Answer call	Answer the call	contact_name	Contact name	Answer Xiaoming's call\|contact_name=Xiaoming
answer_call	Answer call	Answer the call	record	Whether to record	Answer and record\|record=True
reject_phone	Reject call	Don't answer
update_contacts	Update address book	Update address book

Audio recording

Instruction name	Instruction description	Instruction example	Parameter name	Parameter description	Parameter example
audio_recording	Record audio	Start recording	audio_type	Audio type, including the following: Internal, External, Call	Record Bluetooth music\|audio_type=Internal Start live recording\|audio_type=External Start call recording\|audio_type=Call
quit_audio_recording	Exit audio recording	Close the recording application
stop_audio_recording	Stop audio recording	Pause recording

In addition to the system instructions, you can use custom instructions to implement more control skills.

The structure of custom instructions is the same as system instructions. You can create multiple instructions for each instruction type.

Each instruction includes an instruction name, description, and example. If parameters are required, you can also add a parameter name, description, and example.

Instruction name: Use English for the name. This name is used to issue the corresponding instruction.
Instruction description: Explains the purpose of the instruction.
Instruction example: Provide multiple sample utterances to improve the model's accuracy in issuing the instruction.
Parameters: You can set multiple parameters, such as specific adjustment values. Providing examples helps the model understand the meaning of the parameters and issue them more accurately.

For example, to set a group of instructions to adjust the brightness of a desk lamp:

Create an instruction type named "Desk lamp brightness control".
Create an instruction named "brightness_increase" to issue an instruction to increase brightness. You can enter sample utterances that trigger this instruction for model training, such as "Make the desk lamp brighter" and "Increase desk lamp brightness by 20".
To issue specific parameters, add them with a name, description, and example. For example, set a parameter "to" to specify the value to which the desk lamp brightness is increased. Provide a parameter example, such as "Increase brightness to 20, to=20".

You can create multiple instructions for each instruction type. Each instruction can have multiple parameters or no parameters.

After creating an instruction, check it in the custom instruction list and confirm it. The instruction is then automatically enabled in the current application.

To test if the instruction is effective, click Run Now below to start testing.

You can also configure more detailed custom instructions:

Set parameter types such as string, number, boolean, date, enum, and time.
1. number: Set a specific numerical range. For example, you can set the "air conditioner temperature" to 18-30. If a user's instruction contains a parameter outside this range, the model asks for clarification.
2. enum: Set a limited list of enumeration values. If a user's instruction contains a parameter outside this list, the model asks for clarification.
Set as required. If a required parameter is empty, the model asks for clarification.
Instruction examples support different parameter values to help the model understand them more accurately.

Making calls

Instruction name	Instruction description	Instruction example	Parameter name	Description	Parameter description	Required
MAKE_A_PHONE_CALL_phone_call	Make a phone call	Dial 10086 Call the fire department Call Xiaoming's work phone	phone_num	String	Phone number	No
MAKE_A_PHONE_CALL_phone_call	Make a phone call		contact_name	String	Contact	No
CANCEL_phone_call	Cancel call	No, thanks
CREATE_contacts	Create a contact	Create a contact, Xiaowang, 12345678901	phone_num	String	Phone number	Yes
CREATE_contacts	Create a contact	Create a contact, Xiaowang, 12345678901	contact_name	String	Contact name	Yes
ANSWER_phone_call	Answer call	Answer the call
REJECT_phone_call	Reject call	Don't answer
UPDATE_contacts	Update address book	Update Xiaowang's phone number to 12345678901	contact_name	String	The contact to update	Yes
			update_name	String	If updating the contact name, the new name	No
			update_phone	String	If updating the contact phone number, the new phone number	No

Setting alarms

Instruction name	Instruction description	Instruction example	Parameter name	Parameters	Parameter description	Required
SET_clock	Set an alarm	Set an alarm for 6 AM tomorrow Remind me to attend the meeting at 3:30 PM every Friday	time	String	Time to set	Yes
			date	String	Date to set. Standard format: YYYY-MM-DD	No
			content	String	Alarm content or label, such as the purpose of the alarm	No
			repeat	String	Repeat schedule. For example: daily/workdays/Monday/Tuesday/Wednesday/Thursday/Friday/Saturday/Sunday. The default is no repeat.	No