arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2211.04049cs.SEcs.AI
收藏

缓存和复制:使数据科学实验更快,更公平

Caching and Reproducibility: Making Data Science experiments faster and FAIRer

University of Wuppertal(伍珀塔尔大学);FIZ Karlsruhe - Leibniz Institute for Information Infrastructure(FIZ卡尔斯鲁厄——莱布尼茨信息基础设施研究所);National Institute of Informatics(国立信息学研究所)

Moritz Schubotz, Ankit Satpute, Andre Greiner-Petter, Akiko Aizawa, Bela Gipp

摘要:

中小规模的数据科学实验通常依赖于由单个科学家或小团队开发的研究软件。通常没有时间使研究软件快速、可重用和开放获取。其后果是双重的。首先,后续的研究人员必须花费大量的工作时间来构建所提出的假设或实验框架。在最坏的情况下,其他人无法复制实验并将结果重新用于后续研究。其次,假设临时研究软件在通常长时间运行的计算昂贵的实验中失败。在这种情况下,迭代改进软件和重复实验的整体工作给研究人员带来了巨大的时间压力。我们建议将缓存作为研究软件开发过程的一个组成部分,甚至在编写第一行代码之前。本文概述了在数据科学项目中开发研究软件的缓存建议。我们的建议提供了一个规避诸如适当依赖、速度等常见问题的视角。同时,缓存有助于开放科学工作流程中实验的可重复性。关于四项指导原则,即:可查找性、可访问性、互操作性和可重用性(FAIR),我们预见,在研究软件开发中包括拟议的建议将使与该软件相关的数据对机器和人类都更加公平。我们展示的有用性,我们最近完成的研究软件项目在数学信息检索的一些建议。

英文摘要:

Small to medium-scale data science experiments often rely on research software developed ad-hoc by individual scientists or small teams. Often there is no time to make the research software fast, reusable, and open access. The consequence is twofold. First, subsequent researchers must spend significant work hours building upon the proposed hypotheses or experimental framework. In the worst case, others cannot reproduce the experiment and reuse the findings for subsequent research. Second, suppose the ad-hoc research software fails during often long-running computationally expensive experiments. In that case, the overall effort to iteratively improve the software and rerun the experiments creates significant time pressure on the researchers. We suggest making caching an integral part of the research software development process, even before the first line of code is written. This article outlines caching recommendations for developing research software in data science projects. Our recommendations provide a perspective to circumvent common problems such as propriety dependence, speed, etc. At the same time, caching contributes to the reproducibility of experiments in the open science workflow. Concerning the four guiding principles, i.e., Findability, Accessibility, Interoperability, and Reusability (FAIR), we foresee that including the proposed recommendation in a research software development will make the data related to that software FAIRer for both machines and humans. We exhibit the usefulness of some of the proposed recommendations on our recently completed research software project in mathematical information retrieval.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑