工作流程社区峰会:加强计算设施和科学工作流程之间的整合
Workflows Community Summit: Tightening the Integration between Computing Facilities and Scientific Workflows
摘要:
工作流程的重要性突出表现在它们支撑了过去几十年中一些最重要的发现。这些工作流中的许多工作流具有显著的计算、存储和通信需求,因此必须在一系列大规模计算机系统上执行,从本地集群到公共云和即将到来的百万兆级HPC平台。从历史上看,工作流执行的基础设施由复杂的集成系统组成,这些系统由工作流从业者在内部开发,对一系列遗留技术有很强的依赖性。由于对支持工作流的需求不断增加,开发了专用的工作流系统,以提供方便有效地创建、执行和调整工作流的抽象,同时确保可移植性。虽然这些努力都是值得的,但现在有数百个独立的工作流系统。由此产生的工作流系统的技术景观是支离破碎的,这可能会对未来的工作流用户的重大障碍,由于许多看似可比的,但通常是相互不兼容的系统存在。为了应对其中一些挑战,能源部资助的ExaWorks和NSF资助的WorkflowsRI项目于2021年组织了一系列名为“工作流社区峰会”的活动。第三届“工作流社区峰会”从计算中心和设施的角度探讨了工作流的挑战和机遇。第三次峰会汇集了一小群设施代表,目的是了解每个设施目前如何使用工作流程,设施如何与工作流程开发人员和用户互动,工作流程如何与设施路线图相适应,以及设施和工作流程之间更紧密整合的机会。更多信息:https://workflowsri.org/summits/facilities/
英文摘要:
The importance of workflows is highlighted by the fact that they have underpinned some of the most significant discoveries of the past decades. Many of these workflows have significant computational, storage, and communication demands, and thus must execute on a range of large-scale computer systems, from local clusters to public clouds and upcoming exascale HPC platforms. Historically, infrastructures for workflow execution consisted of complex, integrated systems, developed in-house by workflow practitioners with strong dependencies on a range of legacy technologies. Due to the increasing need to support workflows, dedicated workflow systems were developed to provide abstractions for creating, executing, and adapting workflows conveniently and efficiently while ensuring portability. While these efforts are all worthwhile individually, there are now hundreds of independent workflow systems. The resulting workflow system technology landscape is fragmented, which may present significant barriers for future workflow users due to many seemingly comparable, yet usually mutually incompatible, systems that exist. In order to tackle some of these challenges, the DOE-funded ExaWorks and NSF-funded WorkflowsRI projects have organized in 2021 a series of events entitled the "Workflows Community Summit". The third edition of the ``Workflows Community Summit" explored workflows challenges and opportunities from the perspective of computing centers and facilities. The third summit brought together a small group of facilities representatives with the aim to understand how workflows are currently being used at each facility, how facilities would like to interact with workflow developers and users, how workflows fit with facility roadmaps, and what opportunities there are for tighter integration between facilities and workflows. More information at: https://workflowsri.org/summits/facilities/
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。