关于低同步变种的重正交化块经典格拉姆-施特辑特正交性损失的研究
On the loss of orthogonality in low-synchronization variants of reorthogonalized block classical Gram-Schmidt
AI总结:
本文研究了低同步变种的重正交化块经典格拉姆-施特辑特正交性损失问题,证明了某些变种与Householder QR一样稳定,同时分析了同步点减少对稳定性的影响。
摘要:
近年来,通信避免的正交化方案在高性能计算中引起了越来越多的关注。本文针对过去几年中提出的各种块经典格拉姆-施特辑特变种的数值稳定性问题提出了开放性问题。采用抽象框架,其灵活性允许为这些变种的正交性损失提供新的严格界限。我们首先分析了(重正交化)块经典格拉姆-施特辑特的推广形式,并证明仅在第一个块上需要一个
英文摘要:
Interest in communication-avoiding orthogonalization schemes for high-performance computing has been growing recently. This manuscript addresses open questions about the numerical stability of various block classical Gram-Schmidt variants that have been proposed in the past few years. An abstract framework is employed, the flexibility of which allows for new rigorous bounds on the loss of orthogonality in these variants. We first analyze a generalization of (reorthogonalized) block classical Gram-Schmidt and show that a "strong" intrablock orthogonalization routine is only needed for the very first block in order to maintain orthogonality on the level of the unit roundoff. In particular, this ``strong" first step does not have to be a reorthogonalized QR itself and subsequent steps can use less stable QR variants, thus keeping the overall communication costs low. Then, using this variant, which has four synchronization points per block column, we remove the synchronization points one at a time and analyze how each alteration affects the stability of the resulting method. Our analysis shows that the variant requiring only one synchronization per block column cannot be guaranteed to be stable in practice, as stability begins to degrade with the first reduction of synchronization points. Our analysis of block methods also provides new theoretical results for the single-column case. In particular, it is proven that DCGS2 from [Bielich, D. et al. Par. Comput. 112 (2022)] and CGS-2 from [Świrydowicz, K. et al, Num. Lin. Alg. Appl. 28 (2021)] are as stable as Householder QR. Numerical examples from the BlockStab toolbox are included throughout, to help compare variants and illustrate the effects of different choices of intraorthogonalization subroutines.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。