Move mouse using OCR (web page)-Robotic Process Automation(RPA)-阿里云帮助中心

1. Introduction

Note

Use this component to move the mouse to a specified position in Chrome, Edge, or IE browsers using Optical Character Recognition (OCR).

Note

For more information about each input, see the help information in the component panel of the application flow editor.

a. In the capture control, click the View OCR result button.

b. From the OCR engine drop-down list, select a suitable engine. The engine that you select affects the accuracy of character recognition.

Note

Google engine: An offline, lightweight OCR engine with good English recognition capabilities.
Alibaba Cloud engine: A server-based, comprehensive OCR engine that requires authorization. It provides high accuracy in various scenarios.
Paddle engine: An offline, lightweight OCR engine with good Chinese recognition capabilities.

c. Enter the recognition result in the Keyword to recognize input box.

Note

For more information about each output, see the help information in the component panel of the application flow editor.

In the Move mouse using OCR (web page) component, select v_web_obj_1. This is the output of the Open new web page or Get opened web page component.
For Target control, select the captured control.
For OCR engine, select Google.
For Keyword, enter New.
For Shift right distance (pixels), enter 200.
For Shift down distance (pixels), enter 200.
Keep the default values for the other options.

The component moves the mouse 200 pixels to the right and 200 pixels down from the keyword "New".

Use the Open new web page component to open the international Alibaba Cloud website in Chrome.
Use the Move mouse using OCR (web page) component to move the mouse to the target position.

The flow opens the international Alibaba Cloud website in Chrome and moves the mouse to a specified position relative to the keyword.