复制研究被认为是有害的
Replication studies considered harmful
摘要：
人们越来越有兴趣将软件工程建立为一门以证据为基础的学科。为此，复制通常用于获得对经验发现的信心，而不是复制，其目标是显示已发表结果的正确性或有效性。目的：考虑复制研究所需的内容，以确认原始实验并将此理解应用于软件工程。方法：模拟是用来证明为什么确认的预测区间可以令人惊讶的宽。这一分析适用于三个最近的复制。研究结果：结果表明，由于预测区间很宽，几乎所有的复制都是验证性的，所以在这个意义上没有“复制危机”，但是，对知识的贡献是可以忽略不计的。结论：重复经验性的软件工程实验，特别是如果它们动力不足或报告不足，是对科学资源的浪费。相比之下，荟萃分析是大力提倡，使所有相关的实验相结合，以估计人口效应。
英文摘要：
CONTEXT: There is growing interest in establishing software engineering as an evidence-based discipline. To that end, replication is often used to gain confidence in empirical findings, as opposed to reproduction where the goal is showing the correctness, or validity of the published results. OBJECTIVE: To consider what is required for a replication study to confirm the original experiment and apply this understanding in software engineering. METHOD: Simulation is used to demonstrate why the prediction interval for confirmation can be surprisingly wide. This analysis is applied to three recent replications. RESULTS: It is shown that because the prediction intervals are wide, almost all replications are confirmatory, so in that sense there is no 'replication crisis', however, the contributions to knowledge are negligible. CONCLUSIONS: Replicating empirical software engineering experiments, particularly if they are under-powered or under-reported, is a waste of scientific resources. By contrast, meta-analysis is strongly advocated so that all relevant experiments are combined to estimate the population effect.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
