arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.12091cs.DCcs.PF
收藏

TeaMPI --基于复制的恢复能力,没有(性能)问题

TeaMPI -- Replication-based Resilience without the (Performance) Pain

Philipp Samfass, Tobias Weinzierl, Benjamin Hazelwood, Michael Bader

摘要:

在一个我们不能频繁检查点的时代,复制是一种通用的方法,可以构建即使硬件部件发生故障也可以继续运行的数值模拟。然而,复制通常不会在更大的规模上使用,因为简单地镜像计算一旦有效地将机器大小减半,并且保持复制的模拟彼此一致并不是微不足道的。我们证明了ExaHyPE引擎-一个基于任务的双曲方程系统求解器-这是可能实现弹性,而无需在用户端进行重大代码更改,而我们引入了一种新的算法思想,其中复制减少了解决方案的时间。冗余的CPU周期不会“白白”被烧掉。我们的工作采用了弱一致的数据模型,副本独立运行,但通过心跳消息通知对方,他们是否仍然在运行。我们的关键性能思想是让复制模拟的任务共享它们的一些结果,同时我们对每个副本的实际任务执行顺序进行洗牌。通过这种方式,复制的等级可以跳过一些本地计算,并自动开始彼此同步。我们的生产级地震波方程求解器的实验提供的证据表明,这种新的概念有可能使复制负担得起的大规模模拟高性能计算。

英文摘要:

In an era where we can not afford to checkpoint frequently, replication is a generic way forward to construct numerical simulations that can continue to run even if hardware parts fail. Yet, replication often is not employed on larger scales, as naïvely mirroring a computation once effectively halves the machine size, and as keeping replicated simulations consistent with each other is not trivial. We demonstrate for the ExaHyPE engine -- a task-based solver for hyperbolic equation systems -- that it is possible to realise resiliency without major code changes on the user side, while we introduce a novel algorithmic idea where replication reduces the time-to-solution. The redundant CPU cycles are not burned "for nothing". Our work employs a weakly consistent data model where replicas run independently yet inform each other through heartbeat messages whether they are still up and running. Our key performance idea is to let the tasks of the replicated simulations share some of their outcomes, while we shuffle the actual task execution order per replica. This way, replicated ranks can skip some local computations and automatically start to synchronise with each other. Our experiments with a production-level seismic wave-equation solver provide evidence that this novel concept has the potential to make replication affordable for large-scale simulations in high-performance computing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑