Cross-browser compatibility testing is concerned with identifying perceptible differences in the way a Web page is rendered across different browsers or configurations thereof. Existing automated cross-browser compatibility testing methods are generally based on Document Object Model (DOM) analysis, or in some cases, a combination of DOM analysis with screenshot capture and image processing. DOM analysis however may miss incompatibilities that arise not during DOM construction, but rather during rendering. Conversely, DOM analysis produces false alarms because different DOMs may lead to identical or sufficiently similar renderings. This paper presents a novel method for cross-browser testing based purely on image processing. The method relies on image segmentation to extract regions from a Web page and computer vision techniques to extract a set of characteristic features from each region. Regions extracted from a screenshot taken on a baseline browser are compared against regions extracted from the browser under test based on characteristic features. A machine learning classifier is used to determine if differences between two matched regions should be classified as an incompatibility. An evaluation involving 140 pages shows that the proposed method achieves an F-score exceeding 0.9, outperforming a state-of-the-art cross-browser testing tool based on DOM analysis.
Can Commercial Testing Automation Tools Work for IoT? A Case Study of Selenium and Node-Red
背景:由于大规模、数据量和异构性,测试物联网软件具有挑战性。测试自动化是该领域中非常需要的特性。目的:本研究的第一个目标是探索物联网测试自动化的需求和挑战。第二个目标是将商业软件中使用的测试自动化工具集成到物联网环境中。方法:进行了系统的文献综述,以引出物联网测试自动化的要求。遵循设计科学方法,使用商业测试自动化工具Selenium为Node-Red平台编写的物联网应用程序构建测试自动化工具。由此产生的框架使用Selenium Web Driver,用于物联网应用程序的基于浏览器的测试自动化。结果如下:该框架已在多个浏览器上进行了功能测试,并对可维护性、浏览器性能和全面性进行了初步评估。结论:使用商业工具进行物联网自动化测试是可行的。然而,需要全面解决大数据量和数据的并行传输和处理等主要挑战,以实现完全集成。