arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.00897cs.DCcs.PF
收藏

FT-BLAS:一种具有在线容错功能的高性能BLAS实现

FT-BLAS: A High Performance BLAS Implementation With Online Fault Tolerance

Yujia Zhai, Elisabeth Giem, Quan Fan, Kai Zhao, Jinyang Liu, Zizhong Chen

摘要:

基本线性代数子程序(BLAS)是科学计算和机器学习中的核心库。本文介绍了FT-BLAS,BLAS例程的一个新的实现,不仅容忍软错误的飞行,但也提供了现代国家的最先进的BLAS库的性能,广泛使用的处理器,如英特尔Skylake和Cascade Lake。为了适应BLAS的特点,其中包含内存绑定和计算绑定的例程,我们提出了一种混合策略,将容错到我们的全新的BLAS实现:复制计算指令的内存绑定的第1级和第2级BLAS例程,并将基于XML的容错机制计算绑定的第3级BLAS例程。我们的高性能和低开销是从微妙的汇编级优化和内核融合的方法来计算内核。实验结果表明,FT-BLAS提供了高可靠性和高性能--即使在每分钟注入数百个错误的情况下,对于跨越我们进行基准测试的所有三个级别的BLAS的例程,FT-BLAS也比英特尔MKL、OpenBLAS和BLIS分别快3.50%、22.14%和21.70%。

英文摘要:

Basic Linear Algebra Subprograms (BLAS) is a core library in scientific computing and machine learning. This paper presents FT-BLAS, a new implementation of BLAS routines that not only tolerates soft errors on the fly, but also provides comparable performance to modern state-of-the-art BLAS libraries on widely-used processors such as Intel Skylake and Cascade Lake. To accommodate the features of BLAS, which contains both memory-bound and computing-bound routines, we propose a hybrid strategy to incorporate fault tolerance into our brand-new BLAS implementation: duplicating computing instructions for memory-bound Level-1 and Level-2 BLAS routines and incorporating an Algorithm-Based Fault Tolerance mechanism for computing-bound Level-3 BLAS routines. Our high performance and low overhead are obtained from delicate assembly-level optimization and a kernel-fusion approach to the computing kernels. Experimental results demonstrate that FT-BLAS offers high reliability and high performance -- faster than Intel MKL, OpenBLAS, and BLIS by up to 3.50%, 22.14% and 21.70%, respectively, for routines spanning all three levels of BLAS we benchmarked, even under hundreds of errors injected per minute.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑