arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1502.01539cs.DB
收藏

通过云感知来源实现科学工作流程的可重复性

Scientific Workflow Repeatability through Cloud-Aware Provenance

Khawar Hasham, Kamran Munir, Jetendr Shamdasani, Richard McClatchey

摘要:

科学工作流程中数据的转换、分析和解释对于科学工作流程的可重复性和可靠性至关重要。这种科学工作流的起源已经有效地进行了基于网格的科学工作流系统。然而,最近采用基于云的科学工作流提供了一个机会,调查现有方法的适用性或提出新的方法来收集来自云的出处信息,并利用它在云基础设施中的工作流重复性。与网格相比,云的动态特性使其变得困难,因为与网格不同,资源是按需提供的。本文提出了一种新的方法,可以帮助减轻这一挑战。这种方法可以收集云基础设施信息以及工作流起源,并可以在它们之间建立映射。此映射稍后用于在云上重新供应资源。工作流执行的可重复性通过以下方式执行:(a)捕获云基础设施信息(虚拟机配置)以及工作流出处,以及(b)重新供应云上的类似资源并在其上重新执行工作流。初步原型的评价表明,所提出的方法是可行的,可以进一步研究。

英文摘要:

The transformations, analyses and interpretations of data in scientific workflows are vital for the repeatability and reliability of scientific workflows. This provenance of scientific workflows has been effectively carried out in Grid based scientific workflow systems. However, recent adoption of Cloud-based scientific workflows present an opportunity to investigate the suitability of existing approaches or propose new approaches to collect provenance information from the Cloud and to utilize it for workflow repeatability in the Cloud infrastructure. The dynamic nature of the Cloud in comparison to the Grid makes it difficult because resources are provisioned on-demand unlike the Grid. This paper presents a novel approach that can assist in mitigating this challenge. This approach can collect Cloud infrastructure information along with workflow provenance and can establish a mapping between them. This mapping is later used to re-provision resources on the Cloud. The repeatability of the workflow execution is performed by: (a) capturing the Cloud infrastructure information (virtual machine configuration) along with the workflow provenance, and (b) re-provisioning the similar resources on the Cloud and re-executing the workflow on them. The evaluation of an initial prototype suggests that the proposed approach is feasible and can be investigated further.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑