arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1412.7364math.NAcs.DCcs.NA
收藏

容错线性系统求解器中的擦除编码

Erasure coding for fault oblivious linear system solvers

Purdue University(普渡大学)

David F. Gleich, Ananth Grama, Yao Zhu

AI总结:

本文提出基于输入增强的容错方法,通过算法类比擦除编码存储,实现对系统故障的完全无关处理,实验表明该方法在低计算开销下可高效恢复大量故障。

摘要:

在并行和分布式系统扩展到数百万处理核心和广域网络时,处理硬件和软件故障是一个重要问题。传统方法包括检查点重启、主动副本和确定性重放,但都带有资源开销和限制。本文提出基于输入增强的替代方法,通过最小修改算法在增强输入上生成增强输出,执行过程完全不考虑系统故障。在发生一个或多个故障时,通过快速重建方法从增强输出中恢复真实解。我们在求解稀疏线性系统的问题上展示了该方法,提出了输入增强和输出恢复技术。通过详细实验,我们证明该方法可以在低计算开销下对大量故障保持容错。具体而言,我们展示了单个故障可使用不到10%的时间开销进行纠正,即使在极端情况下(故障率为20%),该方法也能以合理开销计算解。这些结果代表了对现有技术的重大改进。

英文摘要:

Dealing with hardware and software faults is an important problem as parallel and distributed systems scale to millions of processing cores and wide area networks. Traditional methods for dealing with faults include checkpoint-restart, active replicas, and deterministic replay. Each of these techniques has associated resource overheads and constraints. In this paper, we propose an alternate approach to dealing with faults, based on input augmentation. This approach, which is an algorithmic analog of erasure coded storage, applies a minimally modified algorithm on the augmented input to produce an augmented output. The execution of such an algorithm proceeds completely oblivious to faults in the system. In the event of one or more faults, the real solution is recovered using a rapid reconstruction method from the augmented output. We demonstrate this approach on the problem of solving sparse linear systems using a conjugate gradient solver. We present input augmentation and output recovery techniques. Through detailed experiments, we show that our approach can be made oblivious to a large number of faults with low computational overhead. Specifically, we demonstrate cases where a single fault can be corrected with less than 10% overhead in time, and even in extreme cases (fault rates of 20%), our approach is able to compute a solution with reasonable overhead. These results represent a significant improvement over the state of the art.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑