arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2009.07782stat.ME
收藏

基于相对效应量的复制成功评估

The assessment of replication success based on relative effect size

Leonhard Held, Charlotte Micheloud, Samuel Pawel

摘要:

为了证实最初的发现,越来越多地进行重复研究。然而,没有既定的标准,如何评估复制成功,在实践中使用许多不同的方法。本文的目的是完善和扩展最近提出的反向贝叶斯方法的分析复制研究。我们展示了这种方法是如何直接关系到相对效应大小,复制原始效应估计的比率。这种观点导致了一个新的建议,重新校准评估复制成功,黄金水平。重新校准确保了对于边缘显著的原始研究,只有在复制效应估计值大于原始估计值时才能实现复制成功。如果原始研究具有显著性且重复样本量足够大,则重复成功的条件把握度可以取任何期望值。与要求原始研究和复制研究具有统计学显著性的标准方法相比,如果复制样本量不小于原始样本量,则黄金水平的复制成功提供了项目功效的均匀增益,并控制了第一类错误率。从四个大型复制项目的数据的应用程序表明,新的方法导致更适当的推论,因为它惩罚收缩的复制估计相比,原来的,同时确保这两个效果的估计是足够令人信服的自己。

英文摘要:

Replication studies are increasingly conducted in order to confirm original findings. However, there is no established standard how to assess replication success and in practice many different approaches are used. The purpose of this paper is to refine and extend a recently proposed reverse-Bayes approach for the analysis of replication studies. We show how this method is directly related to the relative effect size, the ratio of the replication to the original effect estimate. This perspective leads to a new proposal to recalibrate the assessment of replication success, the golden level. The recalibration ensures that for borderline significant original studies replication success can only be achieved if the replication effect estimate is larger than the original one. Conditional power for replication success can then take any desired value if the original study is significant and the replication sample size is large enough. Compared to the standard approach to require statistical significance of both the original and replication study, replication success at the golden level offers uniform gains in project power and controls the Type-I error rate if the replication sample size is not smaller than the original one. An application to data from four large replication projects shows that the new approach leads to more appropriate inferences, as it penalizes shrinkage of the replication estimate compared to the original one, while ensuring that both effect estimates are sufficiently convincing on their own.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑