arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.11585stat.ME
收藏

是时候调整了:通过针对明显选择性推断的调整提高实验心理学的可重复性

Time to adjust: Improving replicability in experimental psychology by adjustment for evident selective inference

Yoav Zeevi, Sofi Astashenko, Liad Mudrik, Yoav Benjamini

AI总结:

针对心理学可重复性危机,本研究揭示多重比较未调整是重要被忽视原因,通过TreeBH程序对88篇论文追溯调整,发现21个结果中20个不可复制,建议将调整作为常规做法以提高可重复性。

摘要:

心理学领域一直在努力应对可重复性危机。各种问题已被确定为这一问题的潜在来源。我们揭示了一个在很大程度上被忽视的潜在来源,并证明其对这一问题的重要贡献:多重比较的做法。我们分析了“心理学可重复性项目”中的88篇论文,发现单篇论文中普遍报告多个结果,数量从4到730不等(平均值M=77.7),且未进行多重比较调整。我们使用一种分层FDR控制程序(TreeBH;Bogomolov等人,2021)追溯性地应用了此类调整。88个结果中有21个在调整后被判定为不显著。这21个结果中有20个确实未能复制,占不可复制发现的超过三分之一,同时保持了97%的检验功效。我们建议这应成为一种常见做法,作为提高实验心理学可重复性的重要手段。

英文摘要:

The field of psychological sciences has been grappling with the replicability crisis. Various issues have been identified as potential sources of this problem. We bring to light a potential source that has largely been overlooked and demonstrate its significant contribution to the problem: the practice of multiple comparisons. We analyzed 88 papers from the Reproducibility Project in Psychology and found that multiple results are commonly reported in a single paper, ranging from 4 to 730 (M=77.7), without multiple comparison adjustments. We retroactively applied such an adjustment using a hierarchical FDR controlling procedure (TreeBH; Bogomolov et al., 2021). 21 of 88 results were deemed insignificant after adjustment. Twenty of these 21 results indeed failed to replicate, constituting over a third of the non-replicable findings, while maintaining 97% power. We propose that this should become a common practice as an essential means to increase replicability in experimental psychology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑