考虑避免0.05显著性水平
Consider avoiding the .05 significance level
摘要:
从贝叶斯统计学的角度来看,原假设显著性检验(NHST)的一些缺点,一旦传统的阈值p值0.05被一个足够小的值所取代,就会变得良性。为了说明,H 0的后验概率表明P=.5,给定的数据恰好使其被NHST拒绝,p值为.05(和均匀的先验),在这里显示对于低于100的大多数N值,(N>=100时甚至超过0.50);相反,当p值为0.001时,N<=100的后验概率不超过0.06(N<9000时也不超过0.25)。更有趣的是,当p值为0.0001时,后验概率变得与N完全无关,因此实际上满足了Cornfield(1966)设定的α公设,即p值本身就是证据的度量。鉴于大多数研究人员将很快转换为以任何形式使用贝叶斯统计的前景较低,因此我们建议鼓励选择保守选择诉诸NHST的研究人员尽可能避免使用p值0.05作为拒绝H 0的阈值。本文的分析可用于重新讨论哪一水平的阈值p值似乎是一个合理的,实际的替代。
英文摘要:
It is suggested that some shortcomings of Null Hypothesis Significance Testing (NHST), viewed from the perspective of Bayesian statistics, turn benign once the traditional threshold p value of .05 is substituted by a sufficiently smaller value. To illustrate, the posterior probability of H0 stating P=.5, given data that just render it rejected by NHST with a p value of .05 (and a uniform prior), is shown here to be not much smaller than .50 for most values of N below 100 (and even exceeds .50 for N>=100); in contrast, with a p value of .001 posterior probability does not exceed .06 for N<=100 (neither .25 for N<9000). Yet more interesting, posterior probability becomes quite independent of N with a p value of .0001, hence practically satisfying the alpha postulate - set by Cornfield (1966) as the condition for p value being a measure of evidence in itself. In view of the low prospect that most researchers will soon convert to use Bayesian statistics in any form, we thus suggest that researchers who elect the conservative option of resorting to NHST be encouraged to avoid as much as possible using a p value of .05 as a threshold for rejecting H0. The analysis presented here may be used to discuss afresh which level of threshold p value seems to be a reasonable, practical substitute.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。