内在可信度的评估和p<0.005的新论点
The Assessment of Intrinsic Credibility and a New Argument for p<0.005
摘要:
最近引入了内在可信度的概念,以检查在没有任何事先支持的情况下“突然”发现的可信度。如果一个显著的结果与从同一数据中得出的怀疑性先验相冲突,则该结果被认为是内在可信的,因为怀疑性先验会使该结果不显著。在本文中,我建议使用贝叶斯先验预测尾概率来评估内在的可信度。对于标准的5%显著性水平,这导致了一个新的p值阈值,该阈值非常接近最近提出的p<0.005标准。我还介绍了可信度比,即相应效应量的标准置信区间的上限与下限之比。我证明了可信度比必须小于5.8,这样一个重要的发现本质上也是可信的。最后,提出了一个p值的内在可信度,这是一个简单的函数的普通p值,并有一个直接的频率论解释的复制效果的概率。
英文摘要:
The concept of intrinsic credibility has been recently introduced to check the credibility of "out of the blue" findings without any prior support. A significant result is deemed intrinsically credible if it is in conflict with a sceptical prior derived from the very same data that would make the effect non-significant. In this paper I propose to use Bayesian prior-predictive tail probabilities to assess intrinsic credibility. For the standard 5% significance level, this leads to a new p-value threshold that is remarkably close to the recently proposed p<0.005 standard. I also introduce the credibility ratio, the ratio of the upper to the lower limit of a standard confidence interval for the corresponding effect size. I show that the credibility ratio has to be smaller than 5.8 such that a significant finding is also intrinsically credible. Finally, a p-value for intrinsic credibility is proposed that is a simple function of the ordinary p-value and has a direct frequentist interpretation in terms of the probability of replicating an effect.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。