Work

GUI testing using computer vision

Year: 2010

Type: conference-paper

Abstract: Testing a GUI's visual behavior typically requires human testers to interact with the GUI and to observe whether the expected results of interaction are presented. This paper presents a new approach to GUI testing using computer vision for testers to automate their tasks. Testers can write a visual test script that uses images to specify which GUI components to interact with and what visual feedback to be observed. Testers can also generate visual test scripts by demonstration. By recording both input events and screen images, it is possible to extract the images of components interacted with and the visual feedback seen by the demonstrator, and generate a visual test script automatically. We show that a variety of GUI behavior can be tested using this approach. Also, we show how this approach can facilitate good testing practices such as unit testing, regression testing, and test-driven development.

Source: CHI Conference on Human Factors in Computing Systems

DOI: 10.1145/1753326.1753555

Authors: Tsung-Hsiang Chang, Tom Yeh, Robert C. Miller

Institutions: Massachusetts Institute of Technology, University of Maryland, College Park

Language: English

Topic: Software Testing and Debugging Techniques

Subfield: Software

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

Funder: National Science Foundation

Award: CAREER: End-user Programming for Web Automation and Visualization