arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.03591cs.DC
收藏

Wilkins:让 HPC 原位工作流变得简单

Wilkins: HPC In Situ Workflows Made Easy

Orcun Yildiz, Dmitriy Morozov, Arnur Nigmetov, Bogdan Nicolae, Tom Peterka

AI总结:

本文提出面向 HPC 的原位工作流系统 Wilkins,通过灵活接口、基于 HDF5 的高性能传输、流控和零代码耦合,实现易用且可扩展高效的科学任务执行。

摘要:

原位方法允许科学家在模拟运行时执行数据分析,从而加快科学发现的步伐。然而,当前的原位工作流系统在应对科学任务日益增长的复杂性和多样化计算需求时面临挑战。在本工作中,我们提出了 Wilkins,这是一个原位工作流系统,旨在实现易用性,同时提供工作流任务的可扩展且高效的执行。Wilkins 提供灵活的工作流描述接口,采用基于 HDF5 的高性能数据传输层,并通过提供流控机制来支持具有不同数据速率的任务。Wilkins 可无缝耦合已经使用 HDF5 的科学任务,而无需修改任务代码。我们使用合成基准测试以及材料科学和宇宙学中的两个科学用例展示了上述特性。

英文摘要:

In situ approaches can accelerate the pace of scientific discoveries by allowing scientists to perform data analysis at simulation time. Current in situ workflow systems, however, face challenges in handling the growing complexity and diverse computational requirements of scientific tasks. In this work, we present Wilkins, an in situ workflow system that is designed for ease-of-use while providing scalable and efficient execution of workflow tasks. Wilkins provides a flexible workflow description interface, employs a high-performance data transport layer based on HDF5, and supports tasks with disparate data rates by providing a flow control mechanism. Wilkins seamlessly couples scientific tasks that already use HDF5, without requiring task code modifications. We demonstrate the above features using both synthetic benchmarks and two science use cases in materials science and cosmology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑