通过社区支持实现期刊的出版后代码验证标准化
Standardization of Post-Publication Code Verification is Possible with the Support of the Community
AI总结:
本文提出通过社区支持实现期刊出版后代码验证标准化,通过修改ACM验证徽章允许研究人员提交代码复现,提升机器学习研究的可重复性。
摘要:
可重复性仍然是机器学习研究中的一个挑战。尽管代码和数据可用性要求变得越来越普遍,但期刊中的出版后验证仍然有限且不正式。本文主张期刊和会议论文集可以实施出版后验证。我们提出对ACM预出版验证徽章的修改,允许独立研究人员将出版后的代码复现提交给期刊,从而在文章元数据中包含可见的验证徽章。每篇文章最多可以获得两个徽章,每个徽章链接到对应的公共仓库中已验证的代码。我们描述了动机、相关举措、正式框架、潜在影响、可能的限制以及替代观点。
英文摘要:
Reproducibility remains a challenge in machine learning research. While code and data availability requirements have become increasingly common, post-publication verification is still limited and unformalized. This position paper argues that journals and conference proceedings should all implement a post-publication verification submission system. We propose a modification to ACM and IEEE Access verification badges that allows independent researchers to submit post-publication code replications directly to the journal or proceedings, leading to visible verification badges included in the article metadata. Each article may earn up to two badges, each linked to verified code in its corresponding public repository. This framework would be a step forward toward a standardized reproducibility policy and would provide young researchers with an opportunity to improve their curriculum. We describe the motivation, related initiatives, a formal framework, the potential impact, possible limitations, and alternative views.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。