通过高效浮点结构设计加速BLAS和LAPACK
Accelerating BLAS and LAPACK via Efficient Floating Point Architecture Design
摘要:
基本线性代数子程序(BLAS)和线性代数包(LAPACK)形成了若干高性能计算(HPC)应用的基本构建块,因此决定了HPC应用的性能。通过对若干算法和架构参数(诸如BLAS/LAPACK例程的有向非循环图中的并行操作的数量、底层平台的存储层次结构中的存储器的大小、存储器的带宽以及底层平台中的计算资源的结构)进行调整来获得这种经调整的包中的性能。在本文中,我们密切关注的影响,浮点单元(FPU)的微体系结构的性能调整的BLAS和LAPACK。我们目前的理论分析不同的浮点运算,如乘法器,加法器,平方根,除法器的流水线深度,其次是表征BLAS和LAPACK,以确定所需的几个参数的理论框架,用于决定最佳流水线深度的浮点运算。一个简单的处理元件(PE)的设计,并表明PE优于最新的定制实现的BLAS和LAPACK的1.1倍到1.5倍的Gflops/W,1.9倍到2.1倍的Gflops/mm^2。
英文摘要:
Basic Linear Algebra Subprograms (BLAS) and Linear Algebra Package (LAPACK) form basic building blocks for several High Performance Computing (HPC) applications and hence dictate performance of the HPC applications. Performance in such tuned packages is attained through tuning of several algorithmic and architectural parameters such as number of parallel operations in the Directed Acyclic Graph of the BLAS/LAPACK routines, sizes of the memories in the memory hierarchy of the underlying platform, bandwidth of the memory, and structure of the compute resources in the underlying platform. In this paper, we closely investigate the impact of the Floating Point Unit (FPU) micro-architecture for performance tuning of BLAS and LAPACK. We present theoretical analysis for pipeline depth of different floating point operations like multiplier, adder, square root, and divider followed by characterization of BLAS and LAPACK to determine several parameters required in the theoretical framework for deciding optimum pipeline depth of the floating operations. A simple design of a Processing Element (PE) is presented and shown that the PE outperforms the most recent custom realizations of BLAS and LAPACK by 1.1X to 1.5X in Gflops/W, and 1.9X to 2.1X in Gflops/mm^2.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。