Object Identification– IRIS

Identify objects using IRIS

IRIS Implementation

IRIS (Image Recognition In Scraping) makes use of the image recognition technique. With IRIS, the user can identify objects that are visible on the screen of the AUT. The AUT screen should be on the foreground to identify objects using IRIS. The objects identified are stored in an image format.

IRIS Object Identification

Click on the screen name in the ‘My Tasks – To Do’ pane  of the Avo Assure Landing Page.

2. Click on a browser icon to launch the browser where the objects will be identified.

3. On clicking the browser icon, a new instance of the selected browser and Avo Assure object identifier window is opened.

4. Enter the URL of the page from which objects are to be identified.

5. Click on the Start IRIS button in the Object Identification window.

Note: While scraping using IRIS, the object which does not change or remains constant is identified as an anchor object. An anchor object is identified as a reference object which can locate all other objects identified using IRIS during runtime.

6. Identify the required object by drawing a rectangle over the object on the screen of AUT.

Note: To identify the anchor object, we draw the rectangle over the object by pressing the Control key. The anchor object is identified by a red rectangle and other objects can be identified by green rectangles.

7. Click on the Stop IRIS button to stop the object identification.

8. On clicking the Stop IRIS button, objects will be stored in an image format on the page.

9. Click on the Save button to save the added objects on the page.

Note:

The anchor object will appear with the ‘const’ label. We can rename the objects identified.
If there are similar objects and an anchor object is missing, on clicking the save button a message pops up to notify that the anchor object is missing.

Updating IRIS Objects

Select any identified object (by IRIS) and click on the 'Edit' button.

2. After selecting an IRIS object, click on the 'Edit' button. The object type that is predicted is displayed along with its Object tag and Image.

3. If the predicted object type is not what is expected, select the correct object type from the object type dropdown.

Note: For IRIS objects that are identified as checkbox/radio button, an extra field of ‘Object Status’ is available. This field represents the checked or unchecked status of the checkbox/ radio button during scrape.

4. Click on the 'Submit' button.

5. On clicking the 'Submit' button, the successfully submitted message will be displayed.

Note: Prediction of an object type for IRIS objects can be enabled or disabled in the ICE configuration window.