arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1807.09899cs.DB
收藏

模式级工作流数据相关标注的验证与推理

Validation and Inference of Schema-Level Workflow Data-Dependency Annotations

Shawn Bowers, Timothy McPhillips, Bertram Ludäscher

摘要:

科学工作流系统的一个优点是它们能够收集运行时起源信息作为执行跟踪。跟踪包括作为工作流运行的一部分调用的计算步骤以及每个工作流步骤消耗和产生的相应数据。跟踪捕获的信息用于推断数据项之间的“世系”关系,这可以帮助回答出处查询,以找到在产生特定工作流输出时所涉及的工作流输入。然而,确定沿袭关系需要理解存在于每个工作流步骤的输入和输出之间的依赖模式,并且该信息通常未被指定或通常由工作流系统假定。例如,大多数方法假设所有输出都依赖于所有输入,这可能导致谱系“误报”。在以前的工作中,我们定义了注释,用于指定计算步骤的输入和输出之间的详细依赖关系。这些注释用于定义相应的规则,以便从跟踪中推断细粒度的数据依赖关系。在本文中,我们扩展了我们以前的工作,考虑依赖性注释的工作流规范的影响。特别是,我们提供了一个推理框架,以确保一组依赖性注释的工作流规范是一致的。该框架还可以推断一个完整的一组注释给定的部分注释的工作流。最后,我们描述了使用答案集编程的推理框架的实现。

英文摘要:

An advantage of scientific workflow systems is their ability to collect runtime provenance information as an execution trace. Traces include the computation steps invoked as part of the workflow run along with the corresponding data consumed and produced by each workflow step. The information captured by a trace is used to infer "lineage" relationships among data items, which can help answer provenance queries to find workflow inputs that were involved in producing specific workflow outputs. Determining lineage relationships, however, requires an understanding of the dependency patterns that exist between each workflow step's inputs and outputs, and this information is often under-specified or generally assumed by workflow systems. For instance, most approaches assume all outputs depend on all inputs, which can lead to lineage "false positives". In prior work, we defined annotations for specifying detailed dependency relationships between inputs and outputs of computation steps. These annotations are used to define corresponding rules for inferring fine-grained data dependencies from a trace. In this paper, we extend our previous work by considering the impact of dependency annotations on workflow specifications. In particular, we provide a reasoning framework to ensure the set of dependency annotations on a workflow specification is consistent. The framework can also infer a complete set of annotations given a partially annotated workflow. Finally, we describe an implementation of the reasoning framework using answer-set programming.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑