arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.06265stat.ME
收藏

I 类错误率通常不会被夸大

Type I Error Rates are Not Usually Inflated

Mark Rubin

AI总结:

本文提出 I 类错误率通常不会被夸大,并通过多种研究实践说明可重复性危机更多源于研究者混淆统计错误与理论错误。

摘要:

I 类错误率的夸大被认为是可重复性危机的成因之一。诸如 p 值操纵等有问题的研究实践被认为会将 I 类错误率夸大至其名义水平之上,从而导致文献中出现意外偏高的假阳性水平,并进而导致意外偏低的重复率。在本文中,我提出一种不同的观点。我认为,有问题的研究实践及其他研究实践通常并不会夸大相关的 I 类错误率。我首先引入 I 类错误率的概念,并区分统计错误与理论错误。随后,我针对模型误设、多重检验、选择性推断、分叉路径、探索性分析、p 值操纵、可选停止、双重使用数据以及 HARKing 等情况阐述我的论点。在每一种情形中,我都证明相关的 I 类错误率通常不会被夸大至其名义水平之上,而在少数被夸大的情况下,这种夸大也很容易被识别并解决。我的结论是,可重复性危机至少可以部分地由研究者对统计错误的误读以及对理论错误的低估来解释。

英文摘要:

The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such as p-hacking are thought to inflate Type I error rates above their nominal level, leading to unexpectedly high levels of false positives in the literature and, consequently, unexpectedly low replication rates. In this article, I offer an alternative view. I argue that questionable and other research practices do not usually inflate relevant Type I error rates. I begin by introducing the concept of Type I error rates and distinguishing between statistical errors and theoretical errors. I then illustrate my argument with respect to model misspecification, multiple testing, selective inference, forking paths, exploratory analyses, p-hacking, optional stopping, double dipping, and HARKing. In each case, I demonstrate that relevant Type I error rates are not usually inflated above their nominal level, and in the rare cases that they are, the inflation is easily identified and resolved. I conclude that the replication crisis may be explained, at least in part, by researchers' misinterpretation of statistical errors and their underestimation of theoretical errors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑