arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2002.07270stat.ME
收藏

你不应该忽略P值

Thou Shalt Not Reject the P-value

Oliver Y. Chén, Raúl G. Saraiva, Guy Nagels, Huy Phan, Tom Schwantje, Hengyi Cao, Jiangtao Gou, Jenna M. Reinen, Bin Xiong, Bangdong Zhi, Xiaojun Wang, Maarten de Vos

摘要:

自18世纪首次出现以来,P值一直是基于假设检验的科学发现的重要组成部分。随着统计引擎的加速,人们开始提出这样的问题,即基于P值的科学发现在多大程度上是可靠的和可重复的,要求调整显著性水平或禁止P值的声音越来越多。受这些问题和讨论的启发,我们在这里探讨P值在科学研究中的有用作用和误用。对于常见的误用和误解,我们为从业者提供适度的建议。此外,我们还比较了统计学显著性与临床相关性。与此同时,我们审查贝叶斯替代寻求证据。最后,我们讨论了使用荟萃分析汇集多项研究的P值来汇总证据的承诺和风险。总的来说,P值支撑了一个有用的概率决策系统,并提供了连续尺度的证据。但它的解释必须是上下文,考虑到科学问题,试验设计(包括模型规格,样本量和显著性水平),统计功效,效应量和再现性。

英文摘要:

Since its debut in the 18th century, the P-value has been an important part of hypothesis testing-based scientific discoveries. As the statistical engine accelerates, questions are beginning to be raised, asking to what extent scientific discoveries based on P-values are reliable and reproducible, and the voice calling for adjusting the significance level or banning the P-value has been increasingly heard. Inspired by these questions and discussions, here we enquire into the useful roles and misuses of the P-value in scientific studies. For common misuses and misinterpretations, we provide modest recommendations for practitioners. Additionally, we compare statistical significance with clinical relevance. In parallel, we review the Bayesian alternatives for seeking evidence. Finally, we discuss the promises and risks of using meta-analysis to pool P-values from multiple studies to aggregate evidence. Taken together, the P-value underpins a useful probabilistic decision-making system and provides evidence at a continuous scale. But its interpretation must be contextual, considering the scientific question, experimental design (including the model specification, sample size, and significance level), statistical power, effect size, and reproducibility.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑