科学工作流管理系统中中间状态推荐的设计
Designing for Recommending Intermediate States in A Scientific Workflow Management System
摘要:
为了顺序地和系统地处理大量数据,对工作流组件(即,模块、数据、配置、端口和链接之间的关联)是科学工作流管理系统(SWfMS)中不可避免的问题。在SWfMS中管理具有出处的数据以支持工作流、模块和数据的可重用性并不是一项简单的任务。处理这样的组件对于用于调查具有不同技术的大型数据集的频繁组装和执行的复杂工作流来说甚至更加繁重(即,各种学习算法或模型)。然而,大量的研究提出了各种技术和技术的管理和推荐服务的SWfMS,但只有极少数的研究考虑的数据管理的SWfMS有效的存储和促进工作流的执行。此外,没有研究从用户的角度询问SWfMS中这种数据管理的有效性和效率。在本文中,我们提出并评估了这样一种新的中间数据管理方法的GUI版本与两个用例(植物表型和生物信息学)。我们称之为GUI-RISPTS(从考虑工具状态的管道推荐中间状态)的技术可以促进具有处理过的数据的工作流的执行(即,工作流中的模块的中间结果),并且因此可以减少SWfMS中的一些模块的计算时间。我们将GUI-RISPTS与现有的工作流管理系统SciWorCS集成在一起。在SciWorCS中,我们提供了一个用户用于选择中间状态推荐的界面(即,模块的结果)。我们从用户的角度研究了GUI-RISP的有效性,并测量了其在工作流执行中的存储和效率方面的开销。
英文摘要:
To process a large amount of data sequentially and systematically, proper management of workflow components (i.e., modules, data, configurations, associations among ports and links) in a Scientific Workflow Management System (SWfMS) is inevitable. Managing data with provenance in a SWfMS to support reusability of workflows, modules, and data is not a simple task. Handling such components is even more burdensome for frequently assembled and executed complex workflows for investigating large datasets with different technologies (i.e., various learning algorithms or models). However, a great many studies propose various techniques and technologies for managing and recommending services in a SWfMS, but only a very few studies consider the management of data in a SWfMS for efficient storing and facilitating workflow executions. Furthermore, there is no study to inquire about the effectiveness and efficiency of such data management in a SWfMS from a user perspective. In this paper, we present and evaluate a GUI version of such a novel approach of intermediate data management with two use cases (Plant Phenotyping and Bioinformatics). The technique we call GUI-RISPTS (Recommending Intermediate States from Pipelines Considering Tool-States) can facilitate executions of workflows with processed data (i.e., intermediate outcomes of modules in a workflow) and can thus reduce the computational time of some modules in a SWfMS. We integrated GUI-RISPTS with an existing workflow management system called SciWorCS. In SciWorCS, we present an interface that users use for selecting the recommendation of intermediate states (i.e., modules' outcomes). We investigated GUI-RISP's effectiveness from users' perspectives along with measuring its overhead in terms of storage and efficiency in workflow execution.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。