Skip to main content

Retrieve element from a screenshot using Vision RPA

Wrk Product avatar
Written by Wrk Product
Updated this week

Retrieve the coordinates of an element using the element description or a reference image within a given screenshot.Outcomes: Success or no resultThis Wrk Action uses AI-generated content. Like all AI content, use with caution; information may be outdated, incomplete, or inaccurate.

Application

  • Vision RPA

Inputs (what you have)

Name

Description

Data Type

Required?

Example

Screenshot

Screenshot to search for the element in

File

Yes

Selection type

The method used to identify the element you want to check for

Predefined Choice List

Yes

Element description

Search section

The section of the visible screen to search for the element in.

Predefined Choice List

No

Bypass element validation?

This Wrk Action will always validate element reference image or element description match with what was found using AI. Set to true to bypass validation

True/False

No

Outputs (what you get)

Name

Description

Data Type

Required?

Example

Search image

Screenshot of the visible screen with the searched section highlighted in a green box and the found element in a red box

File

No

Found element coordinates

Coordinates of the found element within the visible screen

Text (Short)

No

[0, 0, 0, 0]

Match percentage

If reference image provided, the percentage match of the selected element in comparison to the provided reference image

Number with decimals

No

95.1

Outcomes

Name

Description

Success

This status is selected if the job has successfully completed.

No result

This status is selected if the job has successfully completed but no result was produced.

Requirements

  • N/A

Did this answer your question?