arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2209.15602stat.AP
收藏

统计学中再现性的研究现状:一个实证分析

The state of play of reproducibility in Statistics: an empirical analysis

Xin Xiong, Ivor Cribben

摘要:

复制能力,即使用计算机代码和数据复制已发表论文或研究结果的能力,是可靠科学方法的基石。对于科学界无法复制结果的研究,应谨慎对待。在过去的十年中,可重复研究的重要性经常被广泛的科学期刊如\textit{Nature}和\textit{Science}以及国际杂志如\textit{The Economist}所强调。然而,多项研究表明,科学结果在心理学和医学等研究领域往往是不可复制的。统计学是一门涉及开发和研究收集、分析、解释和呈现经验数据的方法的科学,它以其在共享计算机代码和数据方面的开放性而自豪。在本文中,我们通过尝试重现2010-2021年期间利用功能磁共振成像(fMRI)数据在著名期刊上发表的93篇论文的结果,来研究统计学领域的可重复性。总体而言,从计算机代码和数据的角度来看,在所有被检查的93篇论文中,我们只能在14篇(15.1%)论文中重现结果,即论文提供了可执行的计算机代码(或软件)与真实的fMRI数据,我们的结果与论文中的结果相匹配。最后,我们总结了一些针对作者和期刊的建议,以提高统计学研究的可重复性。

英文摘要:

Reproducibility, the ability to reproduce the results of published papers or studies using their computer code and data, is a cornerstone of reliable scientific methodology. Studies where results cannot be reproduced by the scientific community should be treated with caution. Over the past decade, the importance of reproducible research has been frequently stressed in a wide range of scientific journals such as \textit{Nature} and \textit{Science} and international magazines such as \textit{The Economist}. However, multiple studies have demonstrated that scientific results are often not reproducible across research areas such as psychology and medicine. Statistics, the science concerned with developing and studying methods for collecting, analyzing, interpreting and presenting empirical data, prides itself on its openness when it comes to sharing both computer code and data. In this paper, we examine reproducibility in the field of statistics by attempting to reproduce the results in 93 published papers in prominent journals utilizing functional magnetic resonance imaging (fMRI) data during the 2010-2021 period. Overall, from both the computer code and the data perspective, among all the 93 examined papers, we could only reproduce the results in 14 (15.1%) papers, that is, the papers provide both executable computer code (or software) with the real fMRI data, and our results matched the results in the paper. Finally, we conclude with some author-specific and journal-specific recommendations to improve the research reproducibility in statistics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑