工作流程再现性分析的来源和数据差异
Provenance and data differencing for workflow reproducibility analysis
摘要:
科学的基础之一是研究人员必须公布用于实现其结果的方法,以便其他人可以尝试复制它们。这样做的另一个好处是,可以为其他目的采用和调整各种方法。在电子科学领域,服务--通常通过工作流编排,处理数据以生成结果。结果的再现通常不是直接的,因为计算对象可能不可用或者可能自从结果生成以来已经被更新。例如,经常更新服务以修复错误或改进算法。本文从三个方面来解决这些问题。首先,本文引入了一个新的框架来澄清“再现性”的含义范围。其次,它描述了一种新的算法,\PDIFF,它使用的工作流程起源痕迹的比较,以确定是否已复制的实验,主要的创新是,如果不是这种情况下,然后通过图形分析确定的具体点(S)的分歧,帮助任何希望了解这些差异的研究人员。一个关键特性是支持用户定义的语义数据比较运算符。最后,本文介绍了\PDIFF的实现,它利用了电子科学中心平台的力量,在云中制定工作流程。以及自动生成的出处跟踪消费的\PDIFF,该平台支持的存储和重用的旧版本的工作流程,数据和服务,本文展示了如何可以有效地利用这一点,以实现再现和重用。
英文摘要:
One of the foundations of science is that researchers must publish the methodology used to achieve their results so that others can attempt to reproduce them. This has the added benefit of allowing methods to be adopted and adapted for other purposes. In the field of e-Science, services -- often choreographed through workflow, process data to generate results. The reproduction of results is often not straightforward as the computational objects may not be made available or may have been updated since the results were generated. For example, services are often updated to fix bugs or improve algorithms. This paper addresses these problems in three ways. Firstly, it introduces a new framework to clarify the range of meanings of "reproducibility". Secondly, it describes a new algorithm, \PDIFF, that uses a comparison of workflow provenance traces to determine whether an experiment has been reproduced; the main innovation is that if this is not the case then the specific point(s) of divergence are identified through graph analysis, assisting any researcher wishing to understand those differences. One key feature is support for user-defined, semantic data comparison operators. Finally, the paper describes an implementation of \PDIFF that leverages the power of the e-Science Central platform which enacts workflows in the cloud. As well as automatically generating a provenance trace for consumption by \PDIFF, the platform supports the storage and re-use of old versions of workflows, data and services; the paper shows how this can be powerfully exploited in order to achieve reproduction and re-use.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。