arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1706.05988math.NAcs.NA
收藏

数值稳定性的流水线共轭梯度算法变体用于大规模对称线性系统的并行求解

Numerically Stable Variants of the Communication-hiding Pipelined Conjugate Gradients Algorithm for the Parallel Solution of Large Scale Symmetric Linear Systems

University of Antwerp(安特卫普大学)

Siegfried Cools, Wim Vanroose

AI总结:

本文提出并比较了几种稳定化的流水线共轭梯度方法,通过引入特定辅助变量的递归移位,减少局部舍入误差的放大,恢复计算精度并保持并行性能。

摘要:

通过减少每个迭代中的全局同步瓶颈数量并在有用计算工作背后隐藏通信,流水线的Krylov子空间方法在当前的HPC硬件上实现了显著的并行可扩展性改进。然而,这通常以最大可达到精度的降低为代价。本文提出了几种稳定化的流水线共轭梯度方法,并进行了比较。这项工作的主要创新贡献是通过在特定辅助变量的递归中引入移位,对多项递归流水线CG算法进行重新公式化。这些移位减少了残差上局部舍入误差的放大。本文提供的稳定性分析提供了一种严格的方法来在实践中选择最佳的移位值。证明了,在适当选择移位参数的情况下,所得到的移位流水线CG算法恢复了可达到的精度,并在局部舍入误差传播的鲁棒性方面与经典CG几乎相同。在各种SPD基准问题上的数值结果比较了不同稳定化技术的流水线CG算法,显示移位流水线CG算法能够实现高精度,同时表现出优异的并行性能。

英文摘要:

By reducing the number of global synchronization bottlenecks per iteration and hiding communication behind useful computational work, pipelined Krylov subspace methods achieve significantly improved parallel scalability on present-day HPC hardware. However, this typically comes at the cost of a reduced maximal attainable accuracy. This paper presents and compares several stabilized versions of the communication-hiding pipelined Conjugate Gradients method. The main novel contribution of this work is the reformulation of the multi-term recurrence pipelined CG algorithm by introducing shifts in the recursions for specific auxiliary variables. These shifts reduce the amplification of local rounding errors on the residual. The stability analysis presented in this work provides a rigorous method for selection of the optimal shift value in practice. It is shown that, given a proper choice for the shift parameter, the resulting shifted pipelined CG algorithm restores the attainable accuracy and displays nearly identical robustness to local rounding error propagation compared to classical CG. Numerical results on a variety of SPD benchmark problems compare different stabilization techniques for the pipelined CG algorithm, showing that the shifted pipelined CG algorithm is able to attain a high accuracy while displaying excellent parallel performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑