There has been a significant amount of interest regarding the use of diversity-based testing techniques in software testing over the past two decades. Diversity-based testing (DBT) technique uses similarity metrics to leverage the dissimilarity between software artefacts - such as requirements, abstract models, program structures, or inputs - in order to address a software testing problem. DBT techniques have been used to assist in finding solutions to several different types of problems including generating test cases, prioritising them, and reducing very large test suites. This paper is a systematic survey of DBT techniques that summarises the key aspects and trends of 144 papers that report the use of 70 different similarity metrics with 24 different types of software artefacts, which have been used by researchers to tackle 11 different types of software testing problems. We further present an analysis of the recent trends in DBT techniques and review the different application domains to which the techniques have been applied, giving an overview of the tools developed by researchers to do so. Finally, the paper identifies some DBT challenges that are potential topics for future work.
Detecting Non-Optimal Decisions of Embodied Agents via Diversity-Guided Metamorphic Testing
National Supercomputing Center(国家超算中心);School of Computer(计算机学院);Singapore Management University(新加坡国立大学);College of Information Engineering(信息工程学院);School of Computer Science and Technology(计算机科学与技术学院);College of Computing and Data Science(计算与数据科学学院)
Latent Anchor-Driven Test Generation for Deep Neural Networks
School of Electrical Engineering and Computer Science, The University of Queensland, Australia(昆士兰大学电气工程与计算机科学学院);Department of Computer Science, University of Virginia, United States(弗吉尼亚大学计算机科学系)