Windows Computer Use
Updated at:
Supported tools
Tool | Name | Description |
| Create a new AgentBay sandbox and return its ID. | |
| Get the Alibaba Cloud Workspace MCP runtime URL. Single-use; expires after access. | |
| Capture a full-screen screenshot and return a shareable URL. Securely stored. URL expires after 64 minutes. | |
| Release resources after task completion. | |
| Capture a desktop screenshot and upload it to the specified | |
| Execute cmd commands on Windows with a configurable timeout. Returns command output or error. | |
| Close the page | |
| Wait for a specified time (in seconds) | |
| Resize the browser window | |
| Return all console messages | |
| Handle a dialog box | |
| Upload one or more files | |
| Install the configured browser. Call this if the browser is not installed. | |
| Press a key on the keyboard | |
| Navigate to a URL | |
| Go back to the previous page | |
| Go forward to the next page | |
| Return all network requests since the page loaded. | |
| Save the page as a PDF | |
| Capture an accessibility snapshot of the current page | |
| Perform a click action on a web page | |
| Perform a drag-and-drop action between two elements | |
| Hover the mouse over a page element | |
| Type text into an editable element | |
| Select an option in a dropdown menu | |
| Take a screenshot of the current page. You cannot perform actions based on the screenshot. Use | |
| List browser tabs | |
| Open a new tab | |
| Select a tab by index | |
| Close a tab | |
| Generate a Playwright test for a given scenario | |
| Execute shell commands on Windows and return output or error. | |
| Create a directory or ensure it exists. Supports nested paths. No-op if already exists. Works only in allowed directories. | |
| Make line-based edits to a text file. Each edit replaces exact line sequences. Returns a git-style diff. Works only in allowed directories. | |
| Retrieve file or directory metadata: size, creation time, last modified time, permissions, and type. Works only in allowed directories. | |
| Read file contents. Use | |
| Read multiple files simultaneously. Returns each file's content with its path. Individual failures do not stop the operation. Works only in allowed directories. | |
| List all files and directories at the specified path with [FILE] and [DIR] prefixes. Works only in allowed directories. | |
| Move or rename files and directories. Supports cross-directory moves. Fails if the destination exists. Both paths must be in allowed directories. | |
| Recursively search for files and directories matching a pattern. Case-insensitive, matches partial names. Returns full paths. Searches only in allowed directories. | |
| Create or write to a file. Set |
System
Name | Description | Parameters |
| Create a new AgentBay sandbox and return its ID. | |
| Get the Alibaba Cloud Workspace MCP runtime URL. Single-use; expires after access. | |
| Capture a full-screen screenshot and return a shareable URL. Securely stored. URL expires after 64 minutes. | |
| Release resources after task completion. | |
| Capture a desktop screenshot and upload it to the specified | |
| Execute cmd commands on Windows with a configurable timeout. Returns command output or error. | |
Playwright
Name | Description | Parameters |
| Close the page | |
| Wait for a specified time (in seconds) | |
| Resize the browser window | |
| Return all console messages | |
| Handle a dialog box | |
| Upload one or more files | |
| Install the configured browser. Call this if the browser is not installed. | |
| Press a key on the keyboard | |
| Navigate to a URL | |
| Go back to the previous page | |
| Go forward to the next page | |
| Return all network requests since the page loaded. | |
| Save the page as a PDF | |
| Capture an accessibility snapshot of the current page | |
| Perform a click action on a web page | |
| Perform a drag-and-drop action between two elements | |
| Hover the mouse over a page element | |
| Type text into an editable element | |
| Select an option in a dropdown menu | |
| Take a screenshot of the current page. You cannot perform actions based on the screenshot. Use | |
| List browser tabs | |
| Open a new tab | |
| Select a tab by index | |
| Close a tab | |
| Generate a Playwright test for a given scenario | |
Shell
Name | Description | Parameters |
| Execute shell commands on Windows and return output or error. | |
FileSystem
Name | Description | Parameters |
| Create a directory or ensure it exists. Supports nested paths. No-op if already exists. Works only in allowed directories. | |
| Make line-based edits to a text file. Each edit replaces exact line sequences. Returns a git-style diff. Works only in allowed directories. | |
| Retrieve file or directory metadata: size, creation time, last modified time, permissions, and type. Works only in allowed directories. | |
| Read file contents. Use | |
| Read multiple files simultaneously. Returns each file's content with its path. Individual failures do not stop the operation. Works only in allowed directories. | |
| List all files and directories at the specified path with [FILE] and [DIR] prefixes. Works only in allowed directories. | |
| Move or rename files and directories. Supports cross-directory moves. Fails if the destination exists. Both paths must be in allowed directories. | |
| Recursively search for files and directories matching a pattern. Case-insensitive, matches partial names. Returns full paths. Searches only in allowed directories. | |
| Create or write to a file. Set | |
MCP Tool List
{
"playwright": {
"tools": [
{
"name": "browser_close",
"description": "Close the page",
"inputSchema": {
"type": "object",
"properties": {
},
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_wait",
"description": "Wait for a specified time in seconds",
"inputSchema": {
"type": "object",
"properties": {
"time": {
"type": "number",
"description": "The time to wait in seconds"
}
},
"required": [
"time"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_resize",
"description": "Resize the browser window",
"inputSchema": {
"type": "object",
"properties": {
"width": {
"type": "number",
"description": "Width of the browser window"
},
"height": {
"type": "number",
"description": "Height of the browser window"
}
},
"required": [
"width",
"height"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_console_messages",
"description": "Returns all console messages",
"inputSchema": {
"type": "object",
"properties": {
},
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_handle_dialog",
"description": "Handle a dialog",
"inputSchema": {
"type": "object",
"properties": {
"accept": {
"type": "boolean",
"description": "Whether to accept the dialog."
},
"promptText": {
"type": "string",
"description": "The text of the prompt in case of a prompt dialog."
}
},
"required": [
"accept"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_file_upload",
"description": "Upload one or multiple files",
"inputSchema": {
"type": "object",
"properties": {
"paths": {
"type": "array",
"items": {
"type": "string"
},
"description": "The absolute paths to the files to upload. Can be a single file or multiple files."
}
},
"required": [
"paths"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_install",
"description": "Install the browser specified in the config. Call this if you get an error about the browser not being installed.",
"inputSchema": {
"type": "object",
"properties": {
},
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_press_key",
"description": "Press a key on the keyboard",
"inputSchema": {
"type": "object",
"properties": {
"key": {
"type": "string",
"description": "Name of the key to press or a character to generate, such as `ArrowLeft` or `a`"
}
},
"required": [
"key"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_navigate",
"description": "Navigate to a URL",
"inputSchema": {
"type": "object",
"properties": {
"url": {
"type": "string",
"description": "The URL to navigate to"
}
},
"required": [
"url"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_navigate_back",
"description": "Go back to the previous page",
"inputSchema": {
"type": "object",
"properties": {
},
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_navigate_forward",
"description": "Go forward to the next page",
"inputSchema": {
"type": "object",
"properties": {
},
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_network_requests",
"description": "Returns all network requests since loading the page",
"inputSchema": {
"type": "object",
"properties": {
},
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_pdf_save",
"description": "Save page as PDF",
"inputSchema": {
"type": "object",
"properties": {
},
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_snapshot",
"description": "Capture accessibility snapshot of the current page, this is better than screenshot",
"inputSchema": {
"type": "object",
"properties": {
},
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_click",
"description": "Perform click on a web page",
"inputSchema": {
"type": "object",
"properties": {
"element": {
"type": "string",
"description": "Human-readable element description used to obtain permission to interact with the element"
},
"ref": {
"type": "string",
"description": "Exact target element reference from the page snapshot"
}
},
"required": [
"element",
"ref"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_drag",
"description": "Perform drag and drop between two elements",
"inputSchema": {
"type": "object",
"properties": {
"startElement": {
"type": "string",
"description": "Human-readable source element description used to obtain the permission to interact with the element"
},
"startRef": {
"type": "string",
"description": "Exact source element reference from the page snapshot"
},
"endElement": {
"type": "string",
"description": "Human-readable target element description used to obtain the permission to interact with the element"
},
"endRef": {
"type": "string",
"description": "Exact target element reference from the page snapshot"
}
},
"required": [
"startElement",
"startRef",
"endElement",
"endRef"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_hover",
"description": "Hover over element on page",
"inputSchema": {
"type": "object",
"properties": {
"element": {
"type": "string",
"description": "Human-readable element description used to obtain permission to interact with the element"
},
"ref": {
"type": "string",
"description": "Exact target element reference from the page snapshot"
}
},
"required": [
"element",
"ref"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_type",
"description": "Type text into editable element",
"inputSchema": {
"type": "object",
"properties": {
"element": {
"type": "string",
"description": "Human-readable element description used to obtain permission to interact with the element"
},
"ref": {
"type": "string",
"description": "Exact target element reference from the page snapshot"
},
"text": {
"type": "string",
"description": "Text to type into the element"
},
"submit": {
"type": "boolean",
"description": "Whether to submit entered text (press Enter after)"
},
"slowly": {
"type": "boolean",
"description": "Whether to type one character at a time. Useful for triggering key handlers in the page. By default entire text is filled in at once."
}
},
"required": [
"element",
"ref",
"text"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_select_option",
"description": "Select an option in a dropdown",
"inputSchema": {
"type": "object",
"properties": {
"element": {
"type": "string",
"description": "Human-readable element description used to obtain permission to interact with the element"
},
"ref": {
"type": "string",
"description": "Exact target element reference from the page snapshot"
},
"values": {
"type": "array",
"items": {
"type": "string"
},
"description": "Array of values to select in the dropdown. This can be a single value or multiple values."
}
},
"required": [
"element",
"ref",
"values"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_take_screenshot",
"description": "Take a screenshot of the current page. You can't perform actions based on the screenshot, use browser_snapshot for actions.",
"inputSchema": {
"type": "object",
"properties": {
"raw": {
"type": "boolean",
"description": "Whether to return without compression (in PNG format). Default is false, which returns a JPEG image."
},
"element": {
"type": "string",
"description": "Human-readable element description used to obtain permission to screenshot the element. If not provided, the screenshot will be taken of viewport. If element is provided, ref must be provided too."
},
"ref": {
"type": "string",
"description": "Exact target element reference from the page snapshot. If not provided, the screenshot will be taken of viewport. If ref is provided, element must be provided too."
}
},
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_tab_list",
"description": "List browser tabs",
"inputSchema": {
"type": "object",
"properties": {
},
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_tab_new",
"description": "Open a new tab",
"inputSchema": {
"type": "object",
"properties": {
"url": {
"type": "string",
"description": "The URL to navigate to in the new tab. If not provided, the new tab will be blank."
}
},
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_tab_select",
"description": "Select a tab by index",
"inputSchema": {
"type": "object",
"properties": {
"index": {
"type": "number",
"description": "The index of the tab to select"
}
},
"required": [
"index"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_tab_close",
"description": "Close a tab",
"inputSchema": {
"type": "object",
"properties": {
"index": {
"type": "number",
"description": "The index of the tab to close. Closes current tab if not provided."
}
},
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
},
{
"name": "browser_generate_playwright_test",
"description": "Generate a Playwright test for given scenario",
"inputSchema": {
"type": "object",
"properties": {
"name": {
"type": "string",
"description": "The name of the test"
},
"description": {
"type": "string",
"description": "The description of the test"
},
"steps": {
"type": "array",
"items": {
"type": "string"
},
"description": "The steps of the test"
}
},
"required": [
"name",
"description",
"steps"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
}
}
]
},
"ShellServer": {
"tools": [
{
"name": "shell",
"description": "Executes an shell command with timeout and returns the output or an error on windows platform.",
"inputSchema": {
"properties": {
"command": {
"description": "client input command",
"type": "string"
},
"timeout_ms": {
"default": 1000,
"description": "Command execution timeout (unit: milliseconds). If not specified, the default value (such as 1000 milliseconds) is used",
"type": "integer"
}
},
"required": [
"command",
"timeout_ms"
],
"type": "object"
}
}
]
},
"FileSystem": {
"tools": [
{
"name": "create_directory",
"description": "Create a new directory or ensure a directory exists. Can create multiple nested directories in one operation. If the directory already exists, this operation will succeed silently. Perfect for setting up directory structures for projects or ensuring required paths exist. Only works within allowed directories.",
"inputSchema": {
"properties": {
"path": {
"description": "Directory path to create.",
"type": "string"
}
},
"required": [
"path"
],
"type": "object"
}
},
{
"name": "edit_file",
"description": "Make line-based edits to a text file. Each edit replaces exact line sequences with new content. Returns a git-style diff showing the changes made. Only works within allowed directories.",
"inputSchema": {
"properties": {
"dryRun": {
"default": false,
"description": "Preview changes using git-style diff format",
"type": "boolean"
},
"edits": {
"items": {
"properties": {
"newText": {
"description": "Text to replace with",
"type": "string"
},
"oldText": {
"description": "Text to search for - must match exactly",
"type": "string"
}
},
"required": [
"oldText",
"newText"
],
"type": "object"
},
"type": "array"
},
"path": {
"description": "File path to edit.",
"type": "string"
}
},
"required": [
"path",
"edits"
],
"type": "object"
}
},
{
"name": "get_file_info",
"description": "Retrieve detailed metadata about a file or directory. Returns comprehensive information including size, creation time, last modified time, permissions, and type. This tool is perfect for understanding file characteristics without reading the actual content. Only works within allowed directories.",
"inputSchema": {
"properties": {
"path": {
"description": "File or directory path to inspect.",
"type": "string"
}
},
"required": [
"path"
],
"type": "object"
}
},
{
"name": "read_file",
"description": "Read the contents of a file from the file system. You can specify an optional 'offset' (in bytes) to start reading from a specific position, and an optional 'length' (in bytes) to limit how many bytes to read. If 'length' is omitted or 0, the file will be read to the end. Handles various text encodings and provides detailed error messages if the file cannot be read. Only works within allowed directories.",
"inputSchema": {
"properties": {
"length": {
"description": "Number of bytes to read. If omitted or 0, read to end of file.",
"minimum": 0,
"type": "integer"
},
"offset": {
"default": 0,
"description": "Start reading from this byte offset.",
"minimum": 0,
"type": "integer"
},
"path": {
"description": "File path to read.",
"type": "string"
}
},
"required": [
"path"
],
"type": "object"
}
},
{
"name": "read_multiple_files",
"description": "Read the contents of multiple files simultaneously. This is more efficient than reading files one by one when you need to analyze or compare multiple files. Each file's content is returned with its path as a reference. Failed reads for individual files won't stop the entire operation. Only works within allowed directories.",
"inputSchema": {
"properties": {
"paths": {
"description": "Array of file paths to read.",
"items": {
"type": "string"
},
"type": "array"
}
},
"required": [
"paths"
],
"type": "object"
}
},
{
"name": "list_directory",
"description": "Get a detailed listing of all files and directories in a specified path. Results clearly distinguish between files and directories with [FILE] and [DIR] prefixes. This tool is essential for understanding directory structure and finding specific files within a directory. Only works within allowed directories.",
"inputSchema": {
"properties": {
"path": {
"description": "Directory path to list.",
"type": "string"
}
},
"required": [
"path"
],
"type": "object"
}
},
{
"name": "move_file",
"description": "Move or rename files and directories. Can move files between directories and rename them in a single operation. If the destination exists, the operation will fail. Works across different directories and can be used for simple renaming within the same directory. Both source and destination must be within allowed directories.",
"inputSchema": {
"properties": {
"destination": {
"description": "Destination file or directory path.",
"type": "string"
},
"source": {
"description": "Source file or directory path.",
"type": "string"
}
},
"required": [
"source",
"destination"
],
"type": "object"
}
},
{
"name": "search_files",
"description": "Recursively search for files and directories matching a pattern. Searches through all subdirectories from the starting path. The search is case-insensitive and matches partial names. Returns full paths to all matching items. Great for finding files when you don't know their exact location. Only searches within allowed directories.",
"inputSchema": {
"properties": {
"excludePatterns": {
"default": [
],
"description": "Patterns to exclude (optional).",
"items": {
"type": "string"
},
"type": "array"
},
"path": {
"description": "Directory path to start search.",
"type": "string"
},
"pattern": {
"description": "Pattern to match.",
"type": "string"
}
},
"required": [
"path",
"pattern"
],
"type": "object"
}
},
{
"name": "write_file",
"description": "Create a new file or write content to an existing file. You can choose to completely overwrite the file or append to the end by specifying the 'mode' parameter. Use 'overwrite' mode (default) to clear the file before writing, or 'append' mode to add content to the end of the file. Handles text content with proper encoding. Only works within allowed directories.",
"inputSchema": {
"properties": {
"content": {
"description": "Content to write.",
"type": "string"
},
"mode": {
"default": "overwrite",
"description": "Write mode: 'overwrite' to clear file, 'append' to add to end.",
"enum": [
"overwrite",
"append"
],
"type": "string"
},
"path": {
"description": "File path to write.",
"type": "string"
}
},
"required": [
"path",
"content"
],
"type": "object"
}
}
]
},
"Oss": {
"tools": [
{
"name": "oss_env_init",
"description": "Create and initialize OSS environment variables with the specified endpoint, access key ID, access key secret, security token, and region. The temporary security credentials obtained from the STS (Security Token Service). For more information, see: https://help.aliyun.com/zh/oss/developer-reference/use-temporary-access-credentials-provided-by-sts-to-access-oss?spm=a2c4g.11186623.help-menu-search-31815.d_1#9ab17afd7cs4t .",
"inputSchema": {
"properties": {
"access_key_id": {
"description": "The Access Key ID for OSS authentication",
"type": "string"
},
"access_key_secret": {
"description": "The Access Key Secret for OSS authentication",
"type": "string"
},
"endpoint": {
"description": "The OSS service endpoint, e.g., If not specified, the default is https://oss-cn-hangzhou.aliyuncs.com",
"type": "string"
},
"region": {
"description": "The OSS region, e.g., cn-hangzhou. If not specified, the default is cn-hangzhou",
"type": "string"
},
"security_token": {
"description": "The Security Token for OSS authentication",
"type": "string"
}
},
"required": [
"access_key_id",
"access_key_secret",
"security_token"
],
"type": "object"
}
},
{
"name": "oss_upload",
"description": "Upload a local file or directory to the specified OSS bucket. If a directory is specified, it will be compressed into a zip file before uploading. The object name in OSS can be specified; if not, the file or zip name will be used by default. Note: You must call the oss_env_init tool to initialize OSS environment variables before using this tool.",
"inputSchema": {
"properties": {
"bucket": {
"description": "OSS bucket name",
"type": "string"
},
"object": {
"description": "Object key in OSS",
"type": "string"
},
"path": {
"description": "Local file or directory path to upload",
"type": "string"
}
},
"required": [
"bucket",
"object",
"path"
],
"type": "object"
}
},
{
"name": "oss_download",
"description": "Download an object from the specified OSS bucket to the given local path. If the parent directory does not exist, it will be created automatically. If the target file already exists, it will be overwritten. Note: You must call the oss_env_init tool to initialize OSS environment variables before using this tool.",
"inputSchema": {
"properties": {
"bucket": {
"description": "OSS bucket name",
"type": "string"
},
"object": {
"description": "Object key in OSS",
"type": "string"
},
"path": {
"description": "Local path to save the downloaded file",
"type": "string"
}
},
"required": [
"bucket",
"object",
"path"
],
"type": "object"
}
},
{
"name": "oss_upload_annon",
"description": "Upload a local file or directory to the specified URL using HTTP PUT. If a directory is specified, it will be compressed into a zip file before uploading. If the upload target already exists, it will be overwritten.",
"inputSchema": {
"properties": {
"path": {
"description": "Local file or directory path to upload",
"type": "string"
},
"url": {
"description": "The HTTP/HTTPS URL to upload the file to",
"type": "string"
}
},
"required": [
"url",
"path"
],
"type": "object"
}
},
{
"name": "oss_download_annon",
"description": "Download a file from the specified URL to the given local path. If the parent directory does not exist, it will be created automatically. If the target file already exists, it will be overwritten.",
"inputSchema": {
"properties": {
"path": {
"description": "The full local file path to save the downloaded file",
"type": "string"
},
"url": {
"description": "The HTTP/HTTPS URL to download the file from",
"type": "string"
}
},
"required": [
"url",
"path"
],
"type": "object"
}
}
]
}
}Is this page helpful?