包括的方法:使用通用工作流语言标准化计算重用和可移植性
Methods Included: Standardizing Computational Reuse and Portability with the Common Workflow Language
摘要:
计算工作流广泛用于数据分析,支持创新和决策。在许多领域(生物信息学、图像分析和射电天文学)中,分析组件数量众多,并且由第三方以多种不同的计算机语言编写。然而,存在许多相互竞争的工作流程系统,严重限制了这种工作流程的可移植性,从而阻碍了工作流程在不同系统之间、在不同项目和不同设置之间的转移,导致供应商锁定并限制了它们的通用可重用性。在这里,我们提出了通用工作流语言(CWL)项目,该项目为描述基于命令行工具的工作流提供了自由和开放的标准。CWL标准提供了一组通用但精简的抽象,这些抽象在实践中使用并在许多流行的工作流系统中实现。CWL语言是声明性的,它允许表达由不同软件工具构建的计算工作流,每个软件工具通过其命令行界面执行。明确地说明运行时环境和软件容器的任何使用都可以实现可移植性和重用。根据CWL标准编写的工作流是对该分析的可重用描述,可在各种计算环境上运行。这些描述包含足够的信息,无需工作流作者的额外输入即可进行高级优化。CWL标准支持多语言工作流程,实现了这些工作流程的可移植性和重用,简化了例如学术出版,满足监管要求,学术研究和行业之间的合作,同时降低了实施成本。CWL已经被广泛的领域所采用,并且在许多主要的工作流系统中已经实现了行业和支持。
英文摘要:
Computational Workflows are widely used in data analysis, enabling innovation and decision-making. In many domains (bioinformatics, image analysis, & radio astronomy) the analysis components are numerous and written in multiple different computer languages by third parties. However, many competing workflow systems exist, severely limiting portability of such workflows, thereby hindering the transfer of workflows between different systems, between different projects and different settings, leading to vendor lock-ins and limiting their generic re-usability. Here we present the Common Workflow Language (CWL) project which produces free and open standards for describing command-line tool based workflows. The CWL standards provide a common but reduced set of abstractions that are both used in practice and implemented in many popular workflow systems. The CWL language is declarative, which allows expressing computational workflows constructed from diverse software tools, executed each through their command-line interface. Being explicit about the runtime environment and any use of software containers enables portability and reuse. Workflows written according to the CWL standards are a reusable description of that analysis that are runnable on a diverse set of computing environments. These descriptions contain enough information for advanced optimization without additional input from workflow authors. The CWL standards support polylingual workflows, enabling portability and reuse of such workflows, easing for example scholarly publication, fulfilling regulatory requirements, collaboration in/between academic research and industry, while reducing implementation costs. CWL has been taken up by a wide variety of domains, and industries and support has been implemented in many major workflow systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。