arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2004.00243cs.AR
收藏

单片3D ReRAM Crossbar中多通道卷积的高效实现

Efficient Implementation of Multi-Channel Convolution in Monolithic 3D ReRAM Crossbar

Sho Ko, Yun Joon Soh, Jishen Zhao

摘要:

卷积神经网络(CNN)在广泛的应用中表现出有前途的精度。在CNN的所有层中,卷积层是计算密集型的,消耗的能量最多。随着器件和制造技术的成熟,3D电阻式随机存取存储器(ReRAM)由于其高并行性和能量效率优点而在加速大型向量矩阵乘法和卷积方面受到极大关注。然而,在3D ReRAM中天真地实现多通道卷积要么会产生不正确的结果,要么只利用3D ReRAM的部分并行性。在本文中,我们提出了一种基于3D ReRAM的卷积加速器架构,它可以有效地将多通道卷积映射到单片3D ReRAM。我们的设计有两个关键原则。首先,我们利用3D ReRAM的交织结构,通过使用最先进的卷积算法来实现多通道卷积。其次,我们提出了一种新的方法来有效地实现负权重,通过使用可配置的互连将它们与非负权重分离。我们的评估表明,与自定义2D ReRAM基线和最先进的CPU和GPU相比,我们在16层3D ReRAM中的映射方案实现了5.79X,927.81X和36.8X的加速比。与相同基准相比,我们的设计还将能耗降低了2.12倍,1802.64倍和114.1倍。

英文摘要:

Convolutional neural networks (CNNs) demonstrate promising accuracy in a wide range of applications. Among all layers in CNNs, convolution layers are the most computation-intensive and consume the most energy. As the maturity of device and fabrication technology, 3D resistive random access memory (ReRAM) receives substantial attention for accelerating large vector-matrix multiplication and convolution due to its high parallelism and energy efficiency benefits. However, implementing multi-channel convolution naively in 3D ReRAM will either produce incorrect results or exploit only partial parallelism of 3D ReRAM. In this paper, we propose a 3D ReRAM-based convolution accelerator architecture, which efficiently maps multi-channel convolution to monolithic 3D ReRAM. Our design has two key principles. First, we exploit the intertwined structure of 3D ReRAM to implement multi-channel convolution by using a state-of-the-art convolution algorithm. Second, we propose a new approach to efficiently implement negative weights by separating them from non-negative weights using configurable interconnects. Our evaluation demonstrates that our mapping scheme in 16-layer 3D ReRAM achieves a speedup of 5.79X, 927.81X, and 36.8X compared with a custom 2D ReRAM baseline and state-of-the-art CPU and GPU. Our design also reduces energy consumption by 2.12X, 1802.64X, and 114.1X compared with the same baseline.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑