P值:误解和误用
P-values: misunderstood and misused
摘要:
P值在社会科学和自然科学中被广泛用于量化观察结果的统计意义。最近大数据研究的激增使p值成为测试研究意义的更受欢迎的工具。然而,大量的文献已经产生了批评如何使用和理解p值。在本文中,我们回顾了最近的批评文献,其中大部分是路由在生命科学,并考虑其对社会科学研究的影响。我们提供了一个连贯的图片是什么主要的批评,并绘制在一起,消除歧义的共同主题。特别是,我们解释了如何计算错误发现率,以及它与p值的不同之处。我们还明确了贝叶斯性质的许多最近的批评,一个维度,往往被低估或忽视。最后,我们确定了实际步骤,以帮助补救一些确定的问题。我们建议(i)使用显著性水平低得多的方法,如$0.01$或$0.001$,(ii)根据上下文解释p值,并将其置于个体研究结果和更广泛的调查领域(例如,通过荟萃分析)。
英文摘要:
P-values are widely used in both the social and natural sciences to quantify the statistical significance of observed results. The recent surge of big data research has made the p-value an even more popular tool to test the significance of a study. However, substantial literature has been produced critiquing how p-values are used and understood. In this paper we review this recent critical literature, much of which is routed in the life sciences, and consider its implications for social scientific research. We provide a coherent picture of what the main criticisms are, and draw together and disambiguate common themes. In particular, we explain how the False Discovery Rate is calculated, and how this differs from a p-value. We also make explicit the Bayesian nature of many recent criticisms, a dimension that is often underplayed or ignored. We conclude by identifying practical steps to help remediate some of the concerns identified. We recommend that (i) far lower significance levels are used, such as $0.01$ or $0.001$, and (ii) p-values are interpreted contextually, and situated within both the findings of the individual study and the broader field of inquiry (through, for example, meta-analyses).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。