arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.04353cs.MS
收藏

级联GEMM:从低精度获得高精度

Cascading GEMM: High Precision from Low Precision

Devangi N. Parikh, Robert A. van de Geijn, Greg M. Henry

AI总结:

本文提出通过级联多个低精度FP64 GEMM来近似实现高精度FP64x2 GEMM,并基于BLIS框架验证了该方法的性能与精度潜力。

摘要:

本文阐述了利用(就)低精度高性能矩阵-矩阵乘法(GEMM)实现更高精度GEMM的见解与机遇。驱动性案例研究以双精度(FP64)GEMM近似双倍双精度(FP64x2)GEMM,利用了类BLAS库实例化软件(BLIS)框架重构Goto算法的方式。借此,展示了如何将近似FP64x2 GEMM的精度表示为十个“级联”FP64 GEMM。报告了初步性能和精度实验的有前景结果。所展示的技术为更一般地以低精度计算级联实现更高精度计算(针对类GEMM功能)开辟了新的研究方向。

英文摘要:

This paper lays out insights and opportunities for implementing higher-precision matrix-matrix multiplication (GEMM) from (in terms of) lower-precision high-performance GEMM. The driving case study approximates double-double precision (FP64x2) GEMM in terms of double precision (FP64) GEMM, leveraging how the BLAS-like Library Instantiation Software (BLIS) framework refactors the Goto Algorithm. With this, it is shown how approximate FP64x2 GEMM accuracy can be cast in terms of ten ``cascading'' FP64 GEMMs. Promising results from preliminary performance and accuracy experiments are reported. The demonstrated techniques open up new research directions for more general cascading of higher-precision computation in terms of lower-precision computation for GEMM-like functionality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑