Integrate with the multimodal memo agent-Alibaba Cloud Model Studio(Model Studio)-阿里云帮助中心

The multimodal memo agent allows you to create, query, modify, and delete memos by voice. It is ideal for alarms, schedule management, and time-based reminders.

Memo management

The multimodal memo agent has three main use cases:

alarm: Set time-based reminders with a specific time and recurrence pattern. For example, "Set an alarm for 2 p.m. tomorrow" or "Remind me every day at 8 a.m."
schedule: Set reminders for events with a specific time and recurrence pattern. For example, "Remind me to submit the report in one hour" or "Remind me to attend the meeting every Tuesday at 3 p.m."
record: Store important information without a specific time. For example, "Record Manager Chen's phone number, 159xxxxxxxx."

On devices that support visual understanding, you can take a photo to create a memo from the image content. For example, if you say "Help me record my parking spot," the agent triggers the camera, extracts parking spot information from the uploaded image, and saves it in a memo.

Create a memo

1. Create a schedule or alarm

<Time> + <Event> + <Recurrence> (optional)

1.1. One-time reminder

Example input:

Remind me to have lunch at 12 p.m. tomorrow.

Output:

Parameter			Type	Required	Description
commands			Array		A list of commands.
	[0].command_request_id		String	Yes	The request UUID.
	[0].name		String	Yes	The command name. Example: set_reminder
	[0].params		Array		A list of command parameters.
		[0].content	String	No	The reminder content.
		[0].date	String	No	The reminder date, in yyyy-MM-dd format.
		[0].time	String	No	The reminder time, in HH:mm:ss format.
		[0].pic_url_list	List<String>	No	A list of images for a visual memo.
		[0].reminder_id	String	Yes	The unique ID for the reminder.

1.2. Recurring reminder

Example input:

Remind me to have lunch at 12 p.m. every Wednesday.

Output:

Parameter			Type	Required	Description
commands			Array		A list of commands.
	[0].command_request_id		String	Yes	The request UUID.
	[0].name		String	Yes	The command name. Example: set_reminder
	[0].params		Array		A list of command parameters.
		[0].content	String	No	The reminder content.
		[0].time	String	No	The reminder time, in HH:mm:ss format.
		[0].daysOfWeek	List<Integer>	No	The days of the week. For example, to set a reminder for Monday through Wednesday, set this parameter to [1,2,3].
		[0].daysOfMonth	List<Integer>	No	The days of the month. For example, to set a reminder for the 1st, 2nd, and 3rd of every month, set this parameter to [1,2,3].
		[0].monthsOfYear	List<Integer>	No	The months of the year. For example, to set a reminder for January, February, and March, set this parameter to [1,2,3].
		[0].type	String	No	The time interval unit. The default is none. minutely: every N minutes hourly: every N hours daily: every N days weekly: every N weeks monthly: every N months yearly: every N years
		[0].interval	Integer	No	The time interval value. Required if `type` is specified.
		[0].pic_url_list	List<String>	No	A list of images for a visual memo.
		[0].reminder_id	String	Yes	The unique ID for the reminder.

1.3. Interval-based reminder

Example input:

Remind me to drink water every two hours.

Output:

Parameter			Type	Required	Description
commands			Array		A list of commands.
	[0].command_request_id		String	Yes	The request UUID.
	[0].name		String	Yes	The command name. Example: set_reminder
	[0].params		Array		A list of command parameters.
		[0].content	String	No	The reminder content.
		[0].type	String	No	The time interval unit. The default is none. minutely: every N minutes hourly: every N hours daily: every N days weekly: every N weeks monthly: every N months yearly: every N years
		[0].interval	Integer	No	The time interval value. Required if `type` is specified.
		[0].pic_url_list	List<String>	No	A list of images for a visual memo.
		[0].reminder_id	String	Yes	The unique ID for the reminder.

2. Create a record

<Event>

Example input:

Remember that my ID documents are in the desk drawer.

Output:

Parameter			Type	Required	Description
commands			Array		A list of commands.
	[0].command_request_id		String	Yes	The request UUID.
	[0].name		String	Yes	The command name, such as set_reminder.
	[0].params		Array		A list of command parameters.
		[0].content	String	No	The reminder content.
		[0].pic_url_list	List<String>	No	A list of images for a visual memo.
		[0].reminder_id	String	Yes	The unique ID for the reminder.

Modify a memo

Example input:

Postpone the 6 p.m. dinner reminder to 8 p.m. tonight.

Output:

Parameter			Type	Required	Description
commands			Array		A list of commands.
	[0].command_request_id		String	Yes	The request UUID.
	[0].name		String	Yes	The command name, such as update_reminder.
	[0].params		Array		A list of command parameters.
		[0].content	String	No	The reminder content.
		[0].date	String	No	The reminder date, in yyyy-MM-dd format.
		[0].time	String	No	The reminder time, in HH:mm:ss format.
		[0].daysOfWeek	List<Integer>	No	The days of the week. For example, to set a reminder for Monday through Wednesday, set this parameter to [1,2,3].
		[0].daysOfMonth	List<Integer>	No	The days of the month. For example, to set a reminder for the 1st, 2nd, and 3rd of every month, set this parameter to [1,2,3].
		[0].monthsOfYear	List<Integer>	No	The months of the year. For example, to set a reminder for January, February, and March, set this parameter to [1,2,3].
		[0].type	String	No	The time interval unit. The default is none. minutely: every N minutes hourly: every N hours daily: every N days weekly: every N weeks monthly: every N months yearly: every N years
		[0].interval	Integer	No	The time interval value. Required if `type` is specified.
		[0].pic_url_list	List<String>	No	A list of images for a visual memo.
		[0].reminder_id	String	Yes	The unique ID for the reminder.

Delete a memo

Example input:

The work report is no longer needed. Cancel this reminder.

Output:

Parameter			Type	Required	Description
commands			Array		A list of commands.
	[0].command_request_id		String	Yes	The request UUID.
	[0].name		String	Yes	The command name, such as delete_reminder.
	[0].params		Array		A list of command parameters.
		[0].reminder_id	String	Yes	The unique ID for the reminder.