Element Identification - IRIS

IRIS (Image Recognition In Scraping) uses the image recognition technique. With IRIS, the user can identify elements that are visible on the screen of the AUT. The AUT screen should be in the foreground to identify objects using IRIS. The objects identified are stored in an image format.

It can automatically detect and capture UI elements using AI. IRIS comes pre-trained to identify common controls like text fields, dropdowns, buttons, radio buttons, and checkboxes.

Iris has two capture modes:

Auto Mode: IRIS will automatically find and capture whatever elements it recognizes in the application image. Note: If IRIS misses any elements, users can manually select them to capture.

Manual Mode: Users can manually select them to capture. Users should choose a unique, static element on the screen - ideally, one containing text. The captured element can then be verified using the verifyExistIris keyword.

By combining intelligent automated capturing with a manual selection option, Iris allows robust element capturing for legacy applications. The tool simplifies what was previously a complex process for users. Instructions are focused on user needs rather than technical jargon.

Prerequisites

• The Application under test (AUT) must be up and running.

• The Application under test (AUT) must have sufficient privileges for automation.

Note:

• If the AUT is not visible in the taskbar or the foreground, then follow the procedure mentioned: Open Task Manager > Check if the AUT is in the list of tasks.

• If the AUT is not visible in the task list, click on the process/services tab to check if the related AUT process or service is running.

Launch Application Overview:

1. Object Identification methods: Method A and B

   Object Identification Methods determine the supporting technology of the AUT and perform element identification based on the selection.

   • Method A (default): VCL, MFC, VB6, simple WinForms controls and supports most legacy applications.

   • Method B: WinForms, WPF, Store apps, Qt5, browsers.

2. Window Name: The user must enter the window Name of AUT.

3. Process ID: The user must enter the process ID of AUT.

4. Launch Button: To start the Element identification process of the AUT.

Auto Mode Elements Capture

1. The user has to navigate to the Avo Assure home screen.

2. The user has to select the Desktop Application project from the project list.

3. The user has to click the Design Studio button, and the Design Studio screen will be displayed.

4. The user has to click the Capture Elements button, and the Capture Elements window will be displayed.

5. The user has to click the Capture Elements button, and the Desktop dialog box will be displayed.

6. The user has to select the Object Identification Method radio button. Note: The Method A will be selected automatically.

7. The user has to enter the Window Name in the Enter window name field. Or the user has to enter the Process ID in the Enter Process ID field.

8. The user has to click the Launch button and the Desktop Element Identification window, and the entered Desktop Application will be displayed.

9. The user has to select the Auto radio button from the Capture options and click the Start button.

10. The Avo Assure client will capture whatever elements are found through AI capability.

11. The user has to manually identify and capture the specific constant element with text from the screen. Use this captured element as dynamic input in the subsequent steps. Verify the captured element using the 'verifyExistIris' keyword.

12. If required, the user has to capture the elements manually.

13. Once the capture element is done, the user has to click the Stop button.

14. The Capture Elements window will display all the captured elements.

15. The user has to click the Save button to save all the captured elements. Note: Unsaved elements will be indicated with highlighted color. 

16. The system will display a toast message as Scraped data saved successfully.