arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.04229math.NAcs.NA
收藏

求解大型稀疏线性系统的带参数正则化与预测的三精度迭代细化方法

Three-precision iterative refinement with parameter regularization and prediction for solving large sparse linear systems

Jifeng Ge, Juan Zhang

AI总结:

本研究提出GADI框架下的GADI-IR混合精度迭代细化算法,结合FP16低精度计算、参数正则化与GPR参数预测,在保证精度与鲁棒收敛的同时加速大规模稀疏线性系统求解,为高性能计算提供高效方案。

摘要:

本研究在通用交替方向隐式(general alternating-direction implicit,GADI)框架下提出了一种新型混合精度迭代细化算法GADI-IR,旨在高效求解大规模稀疏线性系统。该方法将低精度算术,尤其是半精度(FP16)用于计算密集型内迭代,在保持高数值精度的同时实现了显著加速。通过严谨的向后误差分析并应用正则化参数$α$,解决了FP16中的溢出问题以及低精度带来的收敛性问题等关键挑战。此外,研究将低精度算术融入参数预测过程,采用高斯过程回归(Gaussian process regression,GPR),在不降低性能的前提下大幅减少了计算时间。该方法对由离散偏微分方程产生的大规模线性系统及其他高维问题尤为有效,这类问题对精度和效率均有较高要求。数值实验表明,使用FP16与混合精度策略不仅能加速计算,还能保证鲁棒收敛,使该方法在各类应用中具备优势。研究结果凸显了利用更低精度算术在高性能计算中实现更优计算效率的潜力。

英文摘要:

This study presents a novel mixed-precision iterative refinement algorithm, GADI-IR, within the general alternating-direction implicit (GADI) framework, designed for efficiently solving large-scale sparse linear systems. By employing low-precision arithmetic, particularly half-precision (FP16), for computationally intensive inner iterations, the method achieves substantial acceleration while maintaining high numerical accuracy. Key challenges such as overflow in FP16 and convergence issues for low precision are addressed through careful backward error analysis and the application of a regularization parameter $α$. Furthermore, the integration of low-precision arithmetic into the parameter prediction process, using Gaussian process regression (GPR), significantly reduces computational time without degrading performance. The method is particularly effective for large-scale linear systems arising from discretized partial differential equations and other high-dimensional problems, where both accuracy and efficiency are critical. Numerical experiments demonstrate that the use of FP16 and mixed-precision strategies not only accelerates computation but also ensures robust convergence, making the approach advantageous for various applications. The results highlight the potential of leveraging lower-precision arithmetic to achieve superior computational efficiency in high-performance computing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑