基于ARMv8众核CPU的NUMA感知FFT卷积
NUMA-aware FFT-based Convolution on ARMv8 Many-core CPUs
摘要:
卷积神经网络(Convolutional Neural Network,CNN)是深度学习最具代表性的算法之一,广泛应用于各种人工智能应用中。卷积运算通常占用CNN的大部分计算开销。基于FFT的卷积算法可以通过降低卷积算法的复杂度来提高卷积运算的效率,在众核CPU上实现基于FFT的卷积算法已经有很多研究工作。然而,对于众核CPU中的非均匀存储器访问(NUMA)特性,没有优化。在本文中,我们提出了一个NUMA感知基于FFT的卷积实现的ARMv8众核CPU与NUMA架构。该实现通过FFT变换的数据重排和复矩阵乘法的三级并行化,减少了远程内存访问的次数。在ARMv8多核CPU上的实验结果表明,在大多数情况下,NUMA感知的实现比现有的工作具有更好的性能。
英文摘要:
Convolutional Neural Networks (CNNs), one of the most representative algorithms of deep learning, are widely used in various artificial intelligence applications. Convolution operations often take most of the computational overhead of CNNs. The FFT-based algorithm can improve the efficiency of convolution by reducing its algorithm complexity, there are a lot of works about the high-performance implementation of FFT-based convolution on many-core CPUs. However, there is no optimization for the non-uniform memory access (NUMA) characteristics in many-core CPUs. In this paper, we present a NUMA-aware FFT-based convolution implementation on ARMv8 many-core CPUs with NUMA architectures. The implementation can reduce a number of remote memory access through the data reordering of FFT transformations and the three-level parallelization of the complex matrix multiplication. The experiment results on a ARMv8 many-core CPU with NUMA architectures demonstrate that our NUMA-aware implementation has much better performance than the state-of-the-art work in most cases.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。