arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.21637math.NAcs.NA
收藏

混合精度 HODLR 矩阵

Mixed precision HODLR matrices

Erin Carson, Xinye Chen, Xiaobo Liu

AI总结:

本文研究 HODLR 矩阵的混合精度表示,提出自适应精度构造与存储方案,证明其矩阵-向量乘积和 LU 分解保持稳定性,并通过实验验证。

摘要:

层次矩阵计算因其能够利用数据稀疏结构显著降低许多重要核心计算的复杂度,而在科学与工程界引起了广泛关注。在此类格式中,一种特别流行的选择是 Hierarchical Off-Diagonal Low-Rank(HODLR,层次非对角低秩)格式。本文证明,由低秩矩阵近似的 HODLR 矩阵非对角块可以用低精度表示,而不会降低整体近似质量(误差增长以因子 2 为界)。我们还提出了一种用于构造和存储 HODLR 矩阵的自适应精度方案,并证明使用混合精度不会损害所得 HODLR 矩阵-向量乘积和 LU 分解的数值稳定性。也就是说,这些计算中产生的误差不会显著大于使用单一精度(例如双精度)构造和存储 HODLR 矩阵时的情形。我们的分析还进一步阐明了在 HODLR 矩阵计算中应如何相对于近似误差选择工作精度,以避免观察到有限精度效应。直观而言,当 HODLR 矩阵具有较高程度的近似误差时,后续计算可以在较低精度下执行而不会产生不利影响。我们通过一系列数值实验证明了理论结果的有效性。

英文摘要:

Hierarchical matrix computations have attracted significant attention in the science and engineering community as exploiting data-sparse structures can significantly reduce the computational complexity of many important kernels. One particularly popular option within this class is the Hierarchical Off-Diagonal Low-Rank (HODLR) format. In this paper, we show that the off-diagonal blocks of HODLR matrices that are approximated by low-rank matrices can be represented in low precision without degenerating the quality of the overall approximation (with the error growth bounded by a factor of $2$). We also present an adaptive-precision scheme for constructing and storing HODLR matrices, and we prove that the use of mixed precision does not compromise the numerical stability of the resulting HODLR matrix--vector product and LU factorization. That is, the resulting error in these computations is not significantly greater than the case where we use one precision (say, double) for constructing and storing the HODLR matrix. Our analyses further give insight on how one must choose the working precision in HODLR matrix computations relative to the approximation error in order to not observe the effects of finite precision. Intuitively, when a HODLR matrix is subject to a high degree of approximation error, subsequent computations can be performed in a lower precision without detriment. We demonstrate the validity of our theoretical results through a range of numerical experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑