用于计算材料设计的Python工作流定义
A Python workflow definition for computational materials design
AI总结:
本文提出Python工作流定义(PWD)以促进计算材料设计领域不同工作流管理系统的互操作性和可重现性。
摘要:
在计算材料科学领域,已经开发了多种工作流管理系统(WfMS),但不同的工作流格式阻碍了工作流在该领域的互操作性和可重现性。为了解决这一挑战,我们引入了Python工作流定义(PWD)作为工作流交换格式,以在基于Python的WfMS之间共享工作流,目前包括AiiDA、jobflow和pyiron。这一开发的动机是这三个基于Python的WfMS具有相似性,它们将不同的工作流步骤和数据在它们之间表示为图中的节点和边。通过PWD,我们旨在促进不同WfMS在可发现、可访问、可互操作、可重用(FAIR)工作流背景下的互操作性和可重现性。为了将科学内容与技术复杂性分开,PWD由三个组成部分组成:(1)一个conda环境,它指定了软件依赖关系;(2)一个Python模块,其中包含表示为工作流图中节点的Python函数;(3)一个存储在JavaScript对象表示法(JSON)中的工作流图。第一个版本的PWD支持基于有向无环图(DAG)的工作流。因此,任何在三个WfMS中的一个中定义的基于DAG的工作流都可以导出到PWD,然后导入到其他WfMS中。在导入后,可以调整工作流的输入参数并分配计算资源,然后使用选定的WfMS执行。这种从和到PWD的导入和导出是由实现PWD的Python库在AiiDA、jobflow和pyiron中完成的。
英文摘要:
Numerous Workflow Management Systems (WfMS) have been developed in the field of computational materials science with different workflow formats, hindering interoperability and reproducibility of workflows in the field. To address this challenge, we introduce here the Python Workflow Definition (PWD) as a workflow exchange format to share workflows between Python-based WfMS, currently AiiDA, jobflow, and pyiron. This development is motivated by the similarity of these three Python-based WfMS, that represent the different workflow steps and data transferred between them as nodes and edges in a graph. With the PWD, we aim at fostering the interoperability and reproducibility between the different WfMS in the context of Findable, Accessible, Interoperable, Reusable (FAIR) workflows. To separate the scientific from the technical complexity, the PWD consists of three components: (1) a conda environment that specifies the software dependencies, (2) a Python module that contains the Python functions represented as nodes in the workflow graph, and (3) a workflow graph stored in the JavaScript Object Notation (JSON). The first version of the PWD supports directed acyclic graph (DAG)-based workflows. Thus, any DAG-based workflow defined in one of the three WfMS can be exported to the PWD and afterwards imported from the PWD to one of the other WfMS. After the import, the input parameters of the workflow can be adjusted and computing resources can be assigned to the workflow, before it is executed with the selected WfMS. This import from and export to the PWD is enabled by the PWD Python library that implements the PWD in AiiDA, jobflow, and pyiron.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。