arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1801.04523cs.DC
收藏

收缩或替代:使用原位恢复处理HPC系统中的过程故障

Shrink or Substitute: Handling Process Failures in HPC Systems using In-situ Recovery

Rizwan A. Ashraf, Saurabh Hukerikar, Christian Engelmann

摘要:

当今具有复杂硬件和软件组件的高性能计算(HPC)系统的高效利用要求HPC应用被设计为在运行时容忍进程故障。由于当前和未来HPC系统的平均故障时间(MTTF)较低,在这些系统上长时间运行的模拟需要应用程序本身优雅地处理进程故障的能力。在本文中,我们探讨了使用容错扩展的消息传递接口(MPI)称为用户级故障缓解(ULFM)处理过程中的故障,而不需要放弃的应用程序所取得的进展。我们探讨了两种替代的恢复策略,使用ULFM以及应用程序驱动的内存中检查点。在第一种情况下,仅用存活的进程来恢复应用程序,而在第二种情况下,使用备用进程来替换故障进程,从而恢复应用程序的原始配置。我们的实验结果表明,优雅的退化是一个可行的替代方案,在环境中的备件可能无法使用的恢复。

英文摘要:

Efficient utilization of today's high-performance computing (HPC) systems with complex hardware and software components requires that the HPC applications are designed to tolerate process failures at runtime. With low mean time to failure (MTTF) of current and future HPC systems, long running simulations on these systems require capabilities for gracefully handling process failures by the applications themselves. In this paper, we explore the use of fault tolerance extensions to Message Passing Interface (MPI) called user-level failure mitigation (ULFM) for handling process failures without the need to discard the progress made by the application. We explore two alternative recovery strategies, which use ULFM along with application-driven in-memory checkpointing. In the first case, the application is recovered with only the surviving processes, and in the second case, spares are used to replace the failed processes, such that the original configuration of the application is restored. Our experimental results demonstrate that graceful degradation is a viable alternative for recovery in environments where spares may not be available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑