AI 中文总结
针对查询系统测试难题,提出通过提示输入输出关系的变质关系识别方法,不依赖预定义测试用例或基本事实,可结合其他测试方法,经案例研究验证其适用性与潜力,推动变质测试发展,提高测试效率。
AI 中文摘要
测试基于查询的系统(QBS)面临重大挑战,因为缺乏用于验证的基本事实,且手动测试需要大量时间和精力。本文提出一种方法来应对这些挑战,该方法帮助测试人员识别用于变质测试(MT)的变质关系(MR),而非仅完全依赖先验领域知识。MT是一种通过对程序应用输入转换规则(MR)来缓解预言机问题的流行方法。所提方法通过提示描述输入与输出之间关系的MR来帮助测试人员,当预期关系未满足时可进行故障检测。该方法不依赖预定义测试用例或具体基本事实,适用于实际QBS测试,还可与其他测试方法结合,拓展了QBS测试可能性。对一个实际Web应用的案例研究证明了该方法的适用性和潜力。总体而言,本研究推动了变质测试领域发展,为QBS测试人员提供了提高测试效率的宝贵工具。
英文摘要
Testing query-based systems (QBSs) presents significant challenges due to the absence of ground truth for validation and the extensive time and effort required for manual testing. This paper addresses these challenges by proposing an approach that assists testers in identifying metamorphic relations (MRs) for metamorphic testing (MT) instead of solely and exhaustively relying on prerequisite domain knowledge. MT is an approach rising in popularity employed to alleviate the oracle problem by applying input transformation rules (MRs) to a program. The proposed approach helps the tester by prompting MRs that describe the relationships between inputs and outputs, enabling fault detection when the expected relationship is not met. Unlike traditional testing approaches, this approach does not rely on pre-defined test cases or concrete ground truth, making it suitable for the testing of real-world QBSs. Furthermore, the proposed approach can be combined with other testing methods such as combinatorial testing and fuzz testing, expanding the possibilities for QBS testing. A conducted case study of a real-world web application demonstrates the applicability and potential of the proposed approach. Overall, this research contributes to advancing the field of metamorphic testing and provides a valuable tool for QBS testers to enhance their testing efficiency.
Comments18 pages
Journal refJournal of Information Science and Engineering, Vol. 41, No. 1, pp. 43-60 (2025)
DOI:10.6688/JISE.202501\_41(1).0003