Object Identification– IRIS

Identify objects using IRIS

IRIS Implementation

IRIS (Image Recognition In Scraping) makes use of the image recognition technique. With IRIS, the user can identify objects that are visible on the screen of the AUT. The AUT screen should be on the foreground to identify objects using IRIS. The objects identified are stored in an image format.

IRIS Object Identification

  1. 1.
    Click on the screen name in the ‘My Tasks – To Do’ pane  of the Avo Assure Landing Page.
Landing Page – My Tasks Pane
2. Click on a browser icon to launch the browser where the objects will be identified.
Object Identification Page
3. On clicking the browser icon, a new instance of the selected browser and Avo Assure object identifier window is opened.
4. Enter the URL of the page from which objects are to be identified.
Navigate to URL
5. Click on the Start IRIS button in the Object Identification window.
Start IRIS
Note: While scraping using IRIS, the object which does not change or remains constant is identified as an anchor object. An anchor object is identified as a reference object which can locate all other objects identified using IRIS during runtime.
6. Identify the required object by drawing a rectangle over the object on the screen of AUT.
Identifying Objects using IRIS
Note: To identify the anchor object, we draw the rectangle over the object by pressing the Control key. The anchor object is identified by a red rectangle and other objects can be identified by green rectangles.
7. Click on the Stop IRIS button to stop the object identification.
8. On clicking the Stop IRIS button, objects will be stored in an image format on the page.
Objects identified using IRIS
9. Click on the Save button to save the added objects on the page.
  • The anchor object will appear with the ‘const’ label. We can rename the objects identified.
  • If there are similar objects and an anchor object is missing, on clicking the save button a message pops up to notify that the anchor object is missing.
Saving objects identified using IRIS

Updating IRIS Objects

  1. 1.
    Select any identified object (by IRIS) and click on the 'Edit' button.
View and edit IRIS object
2. After selecting an IRIS object, click on the 'Edit' button. The object type that is predicted is displayed along with its Object tag and Image.
Prediction of IRIS Object Type
3. If the predicted object type is not what is expected, select the correct object type from the object type dropdown.
Selecting the Correct Object Type
Note: For IRIS objects that are identified as checkbox/radio button, an extra field of ‘Object Status’ is available. This field represents the checked or unchecked status of the checkbox/ radio button during scrape.
IRIS Object Details Pop up for Checkbox
4. Click on the 'Submit' button.
Submitting the Correct Object Type
5. On clicking the 'Submit' button, the successfully submitted message will be displayed.
On Submit of the Correct Object Type
Note: Prediction of an object type for IRIS objects can be enabled or disabled in the ICE configuration window.