arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.07222cs.SE
收藏

关于测试有效性(错误)感知的实证研究

On (Mis)perceptions of testing effectiveness: an empirical study

Sira Vegas, Patricia Riofrio, Esperanza Marcos, Natalia Juristo

AI总结:

本研究通过受控实验及复制实验,发现学生在无先前经验时对测试与代码审查技术缺陷检测有效性的感知与实际不符,且感知可能基于自评应用熟练度而非技术偏好。

摘要:

软件开发中一个反复出现的问题是在所采用的技术、方法和工具上做出错误的决策。这些决策大多基于开发者对它们的感知。影响人们感知的一个因素是过去的经验,但它不是唯一因素。在本研究中,我们旨在发现在缺乏先前经验的情况下,不同技术的缺陷检测有效性的感知与其实际有效性之间的匹配程度。为此,我们进行了一项实证研究并进行了复制。在原始研究中,我们与学生进行了一项受控实验,应用两种测试技术和一种代码审查技术。实验结束时,他们接受了一项调查,以了解他们认为哪种技术最有效。结果表明,参与者的感知是错误的,这种不匹配在质量方面代价高昂。为了进一步深入了解结果,我们复制了受控实验,并扩展了调查,加入了关于参与者对技术和程序看法的提问。复制研究的结果证实了原始研究的发现,并表明参与者的感知可能并非基于他们对复杂性或技术偏好的看法,而是基于他们认为自己应用这些技术的熟练程度。

英文摘要:

A recurring problem in software development is incorrect decision making on the techniques, methods and tools to be used. Mostly, these decisions are based on developers' perceptions about them. A factor influencing people's perceptions is past experience, but it is not the only one. In this research, we aim to discover how well the perceptions of the defect detection effectiveness of different techniques match their real effectiveness in the absence of prior experience. To do this, we conduct an empirical study plus a replication. During the original study, we conduct a controlled experiment with students applying two testing techniques and a code review technique. At the end of the experiment, they take a survey to find out which technique they perceive to be most effective. The results show that participants' perceptions are wrong and that this mismatch is costly in terms of quality. In order to gain further insight into the results, we replicate the controlled experiment and extend the survey to include questions about participants' opinions on the techniques and programs. The results of the replicated study confirm the findings of the original study and suggest that participants' perceptions might be based not on their opinions about complexity or preferences for techniques but on how well they think that they have applied the techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑