arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.01520stat.ME
收藏

用于评估复制成功的怀疑贝叶斯因子

The sceptical Bayes factor for the assessment of replication success

Samuel Pawel, Leonhard Held

摘要:

复制研究越来越多地进行,但没有建立复制成功的统计标准。我们提出了一种将反向贝叶斯分析与贝叶斯假设检验相结合的新方法:确定效应大小的怀疑先验,使得原始发现在贝叶斯因子方面不再令人信服。然后将此先验与倡导先验(基于原始研究的效应量的参考后验)进行对比,如果复制数据在更高水平上支持倡导而不是怀疑先验,则宣布复制成功,而原始数据支持怀疑先验而不是原假设。怀疑贝叶斯因子是可以宣布复制成功的最高级别。与现有方法的比较表明,怀疑贝叶斯因子结合了几个概念的可复制性:它确保这两项研究都显示出足够的证据,反对无效和惩罚他们的效果估计不兼容。渐近性质和错误率的分析,以及社会科学复制项目的案例研究显示了该方法的可复制性评估的优势。

英文摘要:

Replication studies are increasingly conducted but there is no established statistical criterion for replication success. We propose a novel approach combining reverse-Bayes analysis with Bayesian hypothesis testing: a sceptical prior is determined for the effect size such that the original finding is no longer convincing in terms of a Bayes factor. This prior is then contrasted to an advocacy prior (the reference posterior of the effect size based on the original study), and replication success is declared if the replication data favour the advocacy over the sceptical prior at a higher level than the original data favoured the sceptical prior over the null hypothesis. The sceptical Bayes factor is the highest level where replication success can be declared. A comparison to existing methods reveals that the sceptical Bayes factor combines several notions of replicability: it ensures that both studies show sufficient evidence against the null and penalises incompatibility of their effect estimates. Analysis of asymptotic properties and error rates, as well as case studies from the Social Sciences Replication Project show the advantages of the method for the assessment of replicability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑