分析软件工程复制组的过程和指南
A Procedure and Guidelines for Analyzing Groups of Software Engineering Replications
摘要：
背景：来自不同团体和机构的研究人员正在通过复制的方式合作建立实验组（即，进行分组复制）。不同的聚合技术被应用于分析组的复制。应用不合适的技术来聚合复制结果可能会破坏复制组从实验结果中提供深入见解的潜力。目标：提供一个包含一组嵌入式指南的分析过程，以聚合软件工程（SE）复制结果。方法：比较SE与医学、药理学等其他成熟实验学科的重复组特征。鉴于他们的差异，限制与联合数据分析的SE复制组和成熟的实验学科提供的指导方针，以分析组的复制，我们建立了一个分析程序与一组嵌入式的指导方针，专门为分析组的SE复制。我们提出的分析程序，以说明其使用的一组代表性的SE复制。结果：在聚合复制结果期间，应利用原始数据中包含的所有信息。我们提出的分析程序，鼓励使用分层的个人参与者数据和聚合数据串联分析组的SE复制。结论：用于分析重复组的聚合技术在研究文章中应该是合理的。这将提高联合成果的可靠性和透明度。拟议中的指导方针应该会减轻这一努力。
英文摘要：
Context: Researchers from different groups and institutions are collaborating on building groups of experiments by means of replication (i.e., conducting groups of replications). Disparate aggregation techniques are being applied to analyze groups of replications. The application of unsuitable techniques to aggregate replication results may undermine the potential of groups of replications to provide in-depth insights from experiment results. Objectives: Provide an analysis procedure with a set of embedded guidelines to aggregate software engineering (SE) replication results. Method: We compare the characteristics of groups of replications for SE and other mature experimental disciplines such as medicine and pharmacology. In view of their differences, the limitations with regard to the joint data analysis of groups of SE replications and the guidelines provided in mature experimental disciplines to analyze groups of replications, we build an analysis procedure with a set of embedded guidelines specifically tailored to the analysis of groups of SE replications. We apply the proposed analysis procedure to a representative group of SE replications to illustrate its use. Results: All the information contained within the raw data should be leveraged during the aggregation of replication results. The analysis procedure that we propose encourages the use of stratified individual participant data and aggregated data in tandem to analyze groups of SE replications. Conclusion: The aggregation techniques used to analyze groups of replications should be justified in research articles. This will increase the reliability and transparency of joint results. The proposed guidelines should ease this endeavor.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
