Independent computational reproducibility of scientific results is rapidly becoming of pivotal importance in scientific progress as computation itself plays a more and more central role in so many branches of science. Historically, reproducibility has followed the familiar Popperian [38] model whereby theory cannot be verified by scientific testing, it can only be falsified. Ultimately, this implies that if an experiment cannot be reproduced independently to some satisfactory level of precision, its value is essentially unquantifiable; put brutally, it is impossible to determine its scientific value. The burgeoning presence of software in most scientific work adds a new and particularly opaque layer of complexity [29]. In spite of much recent interest in many scientific areas, emphasis remains more on procedures, strictures and discussion [12, 14, 16, 29, 30, 37, 41], reflecting the inexperience of most scientific journals when it comes to software, rather than the details of how computational reproducibility is actually achieved, for which there appear to be relatively few guiding examples [6, 10, 17]. After considering basic principles, here we show how full computational reproducibility can be achieved in practice at every stage using a case study of a multi-gigabyte protein study on the open SwissProt protein database, from data download all the way to individual figure by figure reproduction as an exemplar for general scientific computation.
Reference environments: A universal tool for reproducibility in computational biology
在计算科学中对可再现性的驱动引起了广泛的讨论和努力:技术,立法/政策,教育和出版。关于这些主题的讨论并不新鲜,但研究人员、出版商和政策制定者现在都清楚需要采用基于计算结果的声明的可重复性标准。存在许多技术来支持和促进计算结果的复制:Docker等容器化工具,Swave,Bibrar,iPython等文学编程方法或Amazon Web Services等云环境。但这些技术都与特定的编程语言(例如Swave/Swedr到R; iPython到Python)或平台(例如Docker仅适用于64位Linux环境)有关。迄今为止,没有一种方法能够跨越计算生物学和生物技术中所代表的广泛的技术和平台。为了实现跨计算生物学的可重复性,我们展示了一种方法,并提供了一套工具,适用于所有计算工作,不依赖于特定的编程语言或平台。我们从计算生物学的不同领域的一系列论文中提出了已发表的例子,涵盖了该领域的主要语言和技术(Python/R/MATLAB/Fortran/C/Java)。我们的方法为结果的复制和重新计算提供了一个透明和灵活的过程。最终,它最有价值的方面是将计算生物学中的方法与其实现解耦。将出版物的“如何”(方法)与“在哪里”(实施)分开,促进了真正的开放科学,并使整个科学界受益。
EMERALD-UI: An interactive web application to unveil novel protein biology hidden in the suboptimal-alignment space
University of Helsinki(赫尔辛基大学);LAMSADE, CNRS UMR7243, Université Paris Dauphine-PSL(巴黎第九大学 LAMSADE 实验室);Max Planck Institute for Biology Tuebingen(蒂宾根马克斯·普朗克生物研究所);Faculty of Life Sciences, University of Dundee(邓迪大学生命科学学院)
Symmetry-Informed Geometric Representation for Molecules, Proteins, and Crystalline Materials
Mila - Québec Artificial Intelligence Institute(米拉-魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);University of Chinese Academy of Sciences(中国科学院大学);Carnegie Mellon University(卡内基梅隆大学);University of Toronto(多伦多大学);University of California, Berkeley(加州大学伯克利分校);Massachusetts Institute of Technology(麻省理工学院);California Institute of Technology(加州理工学院);National Research Council Canada(加拿大国家研究委员会);University of Ottawa(渥太华大学);HEC Montréal(蒙特利尔高等商学院)