arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.07217cs.SE
收藏

软件工程实验用实验包的内容与结构

Content and structure of laboratory packages for software engineering experiments

Martín Solari, Sira Vegas, Natalia Juristo

AI总结:

本文针对软件工程实验复制数量少的问题,通过评估七次实验复制,提出了能减少复制工作量的实验包内容与结构。

摘要:

背景:实验复制在科学方法中扮演着核心角色。尽管软件工程实验已经相当成熟,但实验复制的数量仍然相对较少。软件工程实验由复杂的概念、流程和制品组成。实验包是研究人员之间转移知识以促进实验复制的手段。目标:本文调查实验复制过程,以找出成功复制实验所需的信息。我们的目标是提出软件工程实验用实验包的内容和结构。方法:我们评估了三个不同实验系列的七次复制。每次复制都有不同的实验者,且该实验者当时对实验不熟悉。在研究的首次迭代中,我们识别了实验事件,然后提出了一个解决这些事件的实验包结构,包括文档可用性改进。我们使用后续迭代来验证和推广实验包结构,以用于所有软件工程实验。我们旨在解决一个特定问题,同时探讨如何为实验包的知识体系做出贡献。结果:我们为三个不同的实验生成了实验包。这些包简化了各自实验的复制。我们进行的评估表明,所提出的实验包方案是可接受的,并且减少了当前软件工程中复制实验所需的工作量。结论:我们认为,我们为实验包提出的内容和结构对其他软件工程实验是有用的。

英文摘要:

Context: Experiment replications play a central role in the scientific method. Although software engineering experimentation has matured a great deal, the number of experiment replications is still relatively small. Software engineering experiments are composed of complex concepts, procedures and artefacts. Laboratory packages are a means of transfer-ring knowledge among researchers to facilitate experiment replications. Objective: This paper investigates the experiment replication process to find out what information is needed to successfully replicate an experiment. Our objective is to propose the content and structure of laboratory packages for software engineering experiments. Method: We evaluated seven replications of three different families of experiments. Each replication had a different experimenter who was, at the time, unfamiliar with the experi-ment. During the first iterations of the study, we identified experimental incidents and then proposed a laboratory package structure that addressed these incidents, including docu-ment usability improvements. We used the later iterations to validate and generalize the laboratory package structure for use in all software engineering experiments. We aimed to solve a specific problem, while at the same time looking at how to contribute to the body of knowledge on laboratory packages. Results: We generated a laboratory package for three different experiments. These packages eased the replication of the respective experiments. The evaluation that we conducted shows that the laboratory package proposal is acceptable and reduces the effort currently required to replicate experiments in software engineering. Conclusion: We think that the content and structure that we propose for laboratory pack-ages can be useful for other software engineering experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑