Skip to main content

Retrieve element from a screenshot using Vision RPA

Wrk Product avatar
Written by Wrk Product
Updated this week

Retrieve the coordinates of an element using the element description or a reference image within a given screenshot.Outcomes: Success or no resultThis Wrk Action uses AI-generated content. Like all AI content, use with caution; information may be outdated, incomplete, or inaccurate.

Application

  • Vision RPA

Inputs (what you have)

Name

Description

Data Type

Required?

Example

Screenshot

Screenshot to search for the element in

File

Yes

Element description

Description of the element to be found within the visible screen. See the documentation for config guidelines

Text (Long)

No

Log in button.

Element reference image

Reference image to find within the visible screen

File

No

Search section

The section of the visible screen to search for the element in

Predefined Choice List

No

Bypass element validation?

This Wrk Action will always validate element reference image or element description match with what was found using AI. Set to true to bypass validation

True/False

No

Outputs (what you get)

Name

Description

Data Type

Required?

Example

Search image

Screenshot of the visible screen with the searched section highlighted in a green box and the found element in a red box

File

No

Found element coordinates

Coordinates of the found element within the visible screen

Text (Short)

No

[0, 0, 0, 0]

Outcomes

Name

Description

Success

This status is selected if the job has successfully completed.

No result

This status is selected if the job has successfully completed but no result was produced.

Requirements

  • N/A

Did this answer your question?