arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1808.05567cs.DC
收藏

解析SIMD架构上的高性能深度学习卷积

Anatomy Of High-Performance Deep Learning Convolutions On SIMD Architectures

Evangelos Georganas, Sasikanth Avancha, Kunal Banerjee, Dhiraj Kalamkar, Greg Henry, Hans Pabst, Alexander Heinecke

摘要:

卷积层在许多种类的深度神经网络中普遍存在,包括卷积神经网络(CNN),其为图像识别、神经机器翻译和语音识别等任务提供最先进的结果。卷积运算在计算上昂贵的性质导致了包括矩阵-矩阵乘法公式和主要针对GPU的直接卷积的实现的激增。在本文中,我们介绍了x86架构的直接卷积内核,特别是Xeon和XeonPhi系统,它们是通过动态编译方法实现的。我们基于JIT的实现显示出接近理论峰值的性能,具体取决于当前的设置和CPU架构。我们还演示了如何将这些JIT优化的内核集成到一个轻量级的多节点图执行模型中。这说明了在CPU上执行最先进的图像识别任务时,单节点和多节点运行会产生高效率和高图像吞吐量。

英文摘要:

Convolution layers are prevalent in many classes of deep neural networks, including Convolutional Neural Networks (CNNs) which provide state-of-the-art results for tasks like image recognition, neural machine translation and speech recognition. The computationally expensive nature of a convolution operation has led to the proliferation of implementations including matrix-matrix multiplication formulation, and direct convolution primarily targeting GPUs. In this paper, we introduce direct convolution kernels for x86 architectures, in particular for Xeon and XeonPhi systems, which are implemented via a dynamic compilation approach. Our JIT-based implementation shows close to theoretical peak performance, depending on the setting and the CPU architecture at hand. We additionally demonstrate how these JIT-optimized kernels can be integrated into a lightweight multi-node graph execution model. This illustrates that single- and multi-node runs yield high efficiencies and high image-throughputs when executing state-of-the-art image recognition tasks on CPUs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑