导航可复现研究的全景:一种预测建模方法
Navigating the Landscape of Reproducible Research: A Predictive Modeling Approach
AI总结:
本文提出一种基于论文制品的双谱系预测建模框架,从作者中心和外部代理两个视角量化评估科学研究的可复现性,并发现可读性与词汇多样性等语言特征与高可复现性等级显著相关。
摘要:
科学论文的可复现性对科学进步至关重要。尽管其重要性不言而喻,但由于缺乏真实基准数据,评估可复现性仍然具有挑战性。预测模型可以通过简化繁琐的评估过程来弥补这一局限。通常,一篇论文的可复现性是根据代码、数据或补充信息等制品的可用性来推断的,往往没有进行广泛的实证调查。为了解决这些问题,我们以论文的制品为基本单元,开发了一个新颖的双谱系框架,重点关注作者中心视角和外部代理视角。我们首先使用作者中心谱系,然后使用外部代理谱系,来指导一种结构化的、基于模型的方法,以量化和评估可复现性。我们探索了影响可复现性的不同因素之间的相互依赖关系,发现可读性和词汇多样性等语言特征与在两个谱系上均达到最高等级的论文密切相关。我们的工作为评估科学研究的可复现性提供了一条模型驱动的路径。本研究的代码、方法和制品可在以下地址公开获取:https://github.com/reproducibilityproject/NLRR/
英文摘要:
The reproducibility of scientific articles is central to the advancement of science. Despite this importance, evaluating reproducibility remains challenging due to the scarcity of ground truth data. Predictive models can address this limitation by streamlining the tedious evaluation process. Typically, a paper's reproducibility is inferred based on the availability of artifacts such as code, data, or supplemental information, often without extensive empirical investigation. To address these issues, we utilized artifacts of papers as fundamental units to develop a novel, dual-spectrum framework that focuses on author-centric and external-agent perspectives. We used the author-centric spectrum, followed by the external-agent spectrum, to guide a structured, model-based approach to quantify and assess reproducibility. We explored the interdependencies between different factors influencing reproducibility and found that linguistic features such as readability and lexical diversity are strongly correlated with papers achieving the highest statuses on both spectrums. Our work provides a model-driven pathway for evaluating the reproducibility of scientific research. The code, methods, and artifacts for our study are publicly available at: https://github.com/reproducibilityproject/NLRR/
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。