基于上下文Bandits的自适应变形测试
Adaptive Metamorphic Testing with Contextual Bandits
摘要:
变形测试是一种软件测试范式,其目的是利用被测系统的必要属性(称为变形关系)来检查其预期输出或生成新的测试用例。变形测试已经成功地测试程序,其中一个完整的预言是不可用的,或测试程序,有不确定性的预期输出,如学习系统。在这篇文章中,我们提出了自适应变形测试作为一个简单而强大的强化学习技术,即上下文强盗,选择一个程序可用的多个变形关系的推广。通过使用上下文强盗,自适应变形测试学习哪些变形关系可能改变源测试用例,从而具有更高的发现错误的机会。我们目前的实验结果在机器学习的两个主要案例研究,即图像分类和目标检测,并确定弱点和鲁棒性边界。自适应变形测试有效地识别了源测试用例中被测系统的弱点。
英文摘要:
Metamorphic Testing is a software testing paradigm which aims at using necessary properties of a system-under-test, called metamorphic relations, to either check its expected outputs, or to generate new test cases. Metamorphic Testing has been successful to test programs for which a full oracle is not available or to test programs for which there are uncertainties on expected outputs such as learning systems. In this article, we propose Adaptive Metamorphic Testing as a generalization of a simple yet powerful reinforcement learning technique, namely contextual bandits, to select one of the multiple metamorphic relations available for a program. By using contextual bandits, Adaptive Metamorphic Testing learns which metamorphic relations are likely to transform a source test case, such that it has higher chance to discover faults. We present experimental results over two major case studies in machine learning, namely image classification and object detection, and identify weaknesses and robustness boundaries. Adaptive Metamorphic Testing efficiently identifies weaknesses of the tested systems in context of the source test case.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。