arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.03863cs.DL
收藏

克服计算可重复性障碍

Overcoming Barriers to Computational Reproducibility

Ludwig-Maximilians-Universität (LMU)(路德维希-马克西米利安大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Weierstrass Institute for Applied Analysis and Stochastics(魏尔斯特拉斯应用分析与随机过程研究所);Max Planck Institute for Demographic Research(马克斯·普朗克人口研究研究所);Technical University of Munich(慕尼黑工业大学);Medical University of Vienna(维也纳医科大学);Lancaster University(兰卡斯特大学);Clemson University(克莱姆森大学);University of California, Berkeley(加州大学伯克利分校);INRAE(法国国家农业、食品与环境研究院);AgroParisTech(巴黎农业学院);Université Paris-Saclay(巴黎萨克雷大学)
Roman Hornung, László Németh, Oleksandr Zadorozhny, Theresa Ullmann, Michael Kammer, Rebecca Killick, Christopher J. Paciorek, Julien Chiquet, Moritz Herrmann, … 展开作者

Roman Hornung, László Németh, Oleksandr Zadorozhny, Theresa Ullmann, Michael Kammer, Rebecca Killick, Christopher J. Paciorek, Julien Chiquet, Moritz Herrmann, Lucija Batinovíc, Rickard Carlsson, Pierre Neuvial, Boris Hejblum, Julia Wrobel, Anne-Laure Boulesteix, Karsten Tabelow

AI总结:

本文提出统一的多层次可重复性标准体系,旨在促进跨学科的透明和一致评估,降低作者和期刊的实践障碍。

摘要:

计算可重复性,即独立研究者能够精确重现已发表的经验结果的可能性,是科学的基础。尽管其重要性,旨在实现可重复性的研究论文比例仍然较低且学科间不均衡。障碍包括研究人员和期刊中 perceived 缺乏激励、准备可重复材料的实践挑战,以及期刊中缺乏统一的可重复性过程和要求。现有的指导通常非常技术性,主要面向已经参与可重复性研究的人群。在本文中,我们首先综合了可重复性对作者和期刊的益处。基于我们在不同期刊进行可重复性检查的广泛经验,我们随后提出了创建跨学科可重复分析的简洁、务实的指南。我们进一步回顾了选定期刊的当前可重复性政策,展示了要求和程序的显著异质性。受后者启发,我们提出了一个统一的多层次可重复性标准体系的概念基础,以支持期刊和研究社区之间的透明、一致评估。我们的目标作为期刊(可重复性)编辑和MaRDI计划的贡献者是鼓励更广泛采用可重复性实践,特别是通过降低作者和期刊的实践障碍。

英文摘要:

Computational reproducibility, the possibility for independent researchers to exactly reproduce published empirical results, is fundamental to science. Despite its importance, the proportion of research articles aiming for reproducibility remains low and uneven across disciplines. Barriers include a perceived lack of incentives for researchers and journals, practical challenges in preparing reproducible materials, and the absence of harmonised standards of reproducibility processes and requirements by journals. Existing guidance is often highly technical, reaching mainly those already engaged with reproducible research. In this paper, we first synthesize evidence on the benefits of reproducibility for both authors and journals. Drawing on our extensive experience in reproducibility checking at various journals, we then put forward concise, pragmatic guidelines for creating reproducible analyses across disciplines. We further review current reproducibility policies of selected journals, illustrating the substantial heterogeneity in requirements and procedures. Motivated by the latter, we propose conceptual foundations for a harmonised multi-tier system of reproducibility standards that could support transparent, consistent assessment across journals and research communities. Our goal as journal (reproducibility) editors and contributors to the MaRDI initiative is to encourage broader adoption of reproducibility practices, in particular by lowering practical barriers for authors and journals.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑