Ensuring the correct visual appearance of graphical user interfaces (GUIs) is important because visual bugs can cause substantial losses for businesses. An application might behave functionally correct in an automated test, but visual bugs can make the GUI effectively unusable for the user. Most of today's approaches for visual testing are pixel-based and tend to have flaws that are characteristic for image differencing. For instance, minor and unimportant visual changes often cause false positives, which confuse the user with unnecessary error reports. Our idea is to introduce an abstract GUI state (AGS), where we define structural relations to identify relevant GUI changes and ignore those that are unimportant from the user's point of view. In addition, we explore several strategies to address the GUI element identification problem in terms of AGS. This allows us to provide rich diagnostic information that help the user to better interpret changes. Based on the principles of golden master testing, we can support a fully-automated approach to visual testing by using the AGS. We have implemented our approach to visually test web pages and our experiments show that we are able to reliably detect GUI changes.
Understanding Automated Web GUI Testing: An Empirical Study Across Exploration Strategies and State Abstractions
SCS, Peking University（北京大学计算科学研究所）；Key Lab of HCST (PKU), MOE（北京大学智能技术与系统国家重点实验室）；University of Texas at Dallas（德克萨斯大学达拉斯分校）；National Engineering Research Center of Software Engineering, MOE（软件工程国家工程研究中心）
GUI Test Migration via Abstraction and Concretization
Key Lab of HCST (PKU), MOE（HCST关键实验室（PKU），教育部）；SCS\ University Beijing China（SCS大学北京中国）；Singapore Management University（新加坡管理学院）；Shanghai Jiao Tong University（上海交通大学）；National University of Singapore（新加坡国立大学）
Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?
Australian National University（澳大利亚国立大学）；Data61, CSIRO（澳大利亚联邦科学与工业研究组织 Data61）；Monash University（蒙纳士大学）；University of New South Wales（新南威尔士大学）；Shanghai Jiao Tong University（上海交通大学）
