arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1606.05696cs.DC
收藏

CPU和GPU上具有扩展BLAS核的张量收缩

Tensor Contractions with Extended BLAS Kernels on CPU and GPU

Yang Shi, U. N. Niranjan, Animashree Anandkumar, Cris Cecka

摘要:

张量压缩构成了数值多线性代数的关键计算成分。然而,随着张量的阶数和维数的增长,基于张量的计算的时间和空间复杂度快速增长。张量收缩的现有方法通常涉及显式复制和转置操作。在本文中,我们提出并评估了一个新的BLAS-like的原始的mendedbatchedgemm,能够有效地执行广泛的张量收缩的CPU和GPU。通过系统的基准测试,我们证明了我们的方法比传统方法的优势。具体地说,我们实现了塔克分解,并表明使用我们的内核产生100倍的加速比使用现有的国家的最先进的库的实现。

英文摘要:

Tensor contractions constitute a key computational ingredient of numerical multi-linear algebra. However, as the order and dimension of tensors grow, the time and space complexities of tensor-based computations grow quickly. Existing approaches for tensor contractions typically involves explicit copy and transpose operations. In this paper, we propose and evaluate a new BLAS-like primitive STRIDEDBATCHEDGEMM that is capable of performing a wide range of tensor contractions on CPU and GPU efficiently. Through systematic benchmarking, we demonstrate the advantages of our approach over conventional approaches. Concretely, we implement the Tucker decomposition and show that using our kernels yields 100x speedup as compared to the implementation using existing state-of-the-art libraries.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑