一种可扩展的大规模并行仿真检查点方案
A Scalable and Extensible Checkpointing Scheme for Massively Parallel Simulations
摘要:
工程或材料科学中的真实仿真可能会消耗大量的计算资源,因此需要使用大规模并行超级计算机。故障的概率随着运行时间和系统组件的数量而增加。因此,对于未来的艾级系统来说,制定策略以使软件对故障具有弹性被认为是至关重要的。在本文中,我们提出了一个可扩展的,分布式的,无盘的,有弹性的检查点方案,可以创建和恢复一个分区的模拟域的快照。我们证明了效率和可扩展性的检查点策略的模拟高达$40$十亿计算单元上执行超过$400$十亿浮点值。一个检查点的创建只需要几秒钟,新的检查点计划的规模几乎完美地超过$260\,000$($2^{18}$)进程。为了在运行期间从无盘检查点恢复,我们使用ULFM MPI实现了恢复算法。检查点机制完全集成在最先进的高性能多物理场仿真框架中。我们证明了该方法的效率和鲁棒性与现实的相场模拟起源于材料科学和晶格玻尔兹曼方法的实施。
英文摘要:
Realistic simulations in engineering or in the materials sciences can consume enormous computing resources and thus require the use of massively parallel supercomputers. The probability of a failure increases both with the runtime and with the number of system components. For future exascale systems it is therefore considered critical that strategies are developed to make software resilient against failures. In this article, we present a scalable, distributed, diskless, and resilient checkpointing scheme that can create and recover snapshots of a partitioned simulation domain. We demonstrate the efficiency and scalability of the checkpoint strategy for simulations with up to $40$ billion computational cells executing on more than $400$ billion floating point values. A checkpoint creation is shown to require only a few seconds and the new checkpointing scheme scales almost perfectly up to more than $260\,000$ ($2^{18}$) processes. To recover from a diskless checkpoint during runtime, we realize the recovery algorithms using ULFM MPI. The checkpointing mechanism is fully integrated in a state-of-the-art high-performance multi-physics simulation framework. We demonstrate the efficiency and robustness of the method with a realistic phase-field simulation originating in the material sciences and with a lattice Boltzmann method implementation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。