计算科学中的再现性案例研究和挑战
Case Studies and Challenges in Reproducibility in the Computational Sciences
摘要：
本文调查了计算科学研究的可重复性，并确定了当今社会面临的主要挑战。这是计算科学研究实验方法的第一个暑期学校的结果（https：//blogs.cs.st-andrews.ac.uk/emcsr2014/）。首先，我们考虑如何复制涉及人类受试者的实验，特别是如何处理不同机构的不同道德要求。其次，我们看看是否并行和分布式计算实验是更多或更少的可重复性比串行的。第三，我们考虑从计算机科学以外的领域可再现的计算实验。我们的最后一个案例研究着眼于一个研究人员的可重复性是否与另一个相同，通过让作者尝试让其他人复制他们自己的，可重复的，论文。这篇论文是开放的，可执行的和可复制的：写这篇论文的整个过程都被捕获在源代码控制存储库中，存储着论文的源代码，补充代码和数据;我们正在为我们正在做的几个实验提供设置;最后，我们试图描述我们在学校的一周里所取得的成就，其他人可以复制（并希望改进）我们的实验。
英文摘要：
This paper investigates the reproducibility of computational science research and identifies key challenges facing the community today. It is the result of the First Summer School on Experimental Methodology in Computational Science Research (https://blogs.cs.st-andrews.ac.uk/emcsr2014/). First, we consider how to reproduce experiments that involve human subjects, and in particular how to deal with different ethics requirements at different institutions. Second, we look at whether parallel and distributed computational experiments are more or less reproducible than serial ones. Third, we consider reproducible computational experiments from fields outside computer science. Our final case study looks at whether reproducibility for one researcher is the same as for another, by having an author attempt to have others reproduce their own, reproducible, paper. This paper is open, executable and reproducible: the whole process of writing this paper is captured in the source control repository hosting both the source of the paper, supplementary codes and data; we are providing setup for several experiments on which we were working; finally, we try to describe what we have achieved during the week of the school in a way that others may reproduce (and hopefully improve) our experiments.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
