arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.09618math.NAcs.NA
收藏

利用动量动态加速幂迭代

Dynamically accelerating the power iteration with momentum

Christian Austin, Sara Pollock, Yunrong Zhu

AI总结:

本文提出一种基于Rayleigh商和残差动态更新动量参数的加速方法,以极小计算开销提升幂迭代和逆幂迭代的收敛速度,无需先验谱信息,并在对称情形下证明收敛,实验表明其优于标准幂迭代和最优静态动量加速。

摘要:

在本文中,我们提出、分析并演示了一种动态动量方法,以最小的计算开销加速幂迭代和逆幂迭代。该方法可应用于实可对角化矩阵,在对称情形下可证明收敛且具有加速效果,并且不需要先验的谱知识。我们回顾并扩展了先前关于幂迭代静态动量加速的背景结果,通过动量加速迭代与应用于增广矩阵的标准幂迭代之间的联系进行说明。我们证明,在最优参数选择下,增广矩阵是亏损的。然后我们提出动态方法,该方法在每次迭代中基于Rayleigh商和两个先前的残差更新动量参数。我们通过考虑一种类幂方法(即将初始向量乘以一系列增广矩阵)来给出该方法的收敛性和稳定性理论。我们在多个基准问题上演示了所开发的方法,并发现它优于幂迭代,且通常也优于具有最优参数选择的静态动量加速。最后,我们提出并演示了该算法对逆幂迭代的显式扩展。

英文摘要:

In this paper, we propose, analyze and demonstrate a dynamic momentum method to accelerate power and inverse power iterations with minimal computational overhead. The method can be applied to real diagonalizable matrices, is provably convergent with acceleration in the symmetric case, and does not require a priori spectral knowledge. We review and extend background results on previously developed static momentum accelerations for the power iteration through the connection between the momentum accelerated iteration and the standard power iteration applied to an augmented matrix. We show that the augmented matrix is defective for the optimal parameter choice. We then present our dynamic method which updates the momentum parameter at each iteration based on the Rayleigh quotient and two previous residuals. We present convergence and stability theory for the method by considering a power-like method consisting of multiplying an initial vector by a sequence of augmented matrices. We demonstrate the developed method on a number of benchmark problems, and see that it outperforms both the power iteration and often the static momentum acceleration with optimal parameter choice. Finally, we present and demonstrate an explicit extension of the algorithm to inverse power iterations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑