arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2107.02358cs.ARcs.AIcs.LG
收藏

片上互连对深度神经网络内存加速的影响

Impact of On-Chip Interconnect on In-Memory Acceleration of Deep Neural Networks

Arizona State University(亚利桑那州立大学);University of Wisconsin-Madison(威斯康星大学麦迪逊分校)

Gokul Krishnan, Sumit K. Mandal, Chaitali Chakrabarti, Jae-sun Seo, Umit Y. Ogras, Yu Cao

摘要:

随着深度神经网络(DNN)的广泛使用,机器学习算法已经朝着两个不同的方向发展-一个是不断增加的连接密度以获得更好的准确性,另一个是更紧凑的尺寸以提高能效。连接密度的增加增加了片上数据移动,这使得高效的片上通信成为DNN加速器的关键功能。这项工作的贡献是三方面的。首先,我们说明了基于点对点(P2P)的互连无法处理DNN的大量片上数据移动。其次,我们评估P2P和片上网络(NoC)互连(具有规则的拓扑结构,如网格)的SRAM和ReRAM为基础的存内计算(IMC)架构的DNN的范围。该分析显示了IMC DNN加速器的最佳互连选择的必要性。最后,我们对不同的DNN进行了实验评估,以经验方式获得具有NoC树和NoC网格的IMC架构的性能。我们的结论是,在瓦片级,NoC-tree是适合紧凑的DNN在边缘使用,NoC-mesh是必要的,以加速DNN与高连接密度。此外,我们提出了一种技术来确定任何给定DNN的互连的最佳选择。在这项技术中,我们使用NoC的分析模型来评估任何给定DNN的端到端通信延迟。我们证明了IMC架构中的互连优化与最先进的基于ReRAM的IMC架构相比,VGG-19推断的能量延迟面积积提高了多达6 $\times$。

英文摘要:

With the widespread use of Deep Neural Networks (DNNs), machine learning algorithms have evolved in two diverse directions -- one with ever-increasing connection density for better accuracy and the other with more compact sizing for energy efficiency. The increase in connection density increases on-chip data movement, which makes efficient on-chip communication a critical function of the DNN accelerator. The contribution of this work is threefold. First, we illustrate that the point-to-point (P2P)-based interconnect is incapable of handling a high volume of on-chip data movement for DNNs. Second, we evaluate P2P and network-on-chip (NoC) interconnect (with a regular topology such as a mesh) for SRAM- and ReRAM-based in-memory computing (IMC) architectures for a range of DNNs. This analysis shows the necessity for the optimal interconnect choice for an IMC DNN accelerator. Finally, we perform an experimental evaluation for different DNNs to empirically obtain the performance of the IMC architecture with both NoC-tree and NoC-mesh. We conclude that, at the tile level, NoC-tree is appropriate for compact DNNs employed at the edge, and NoC-mesh is necessary to accelerate DNNs with high connection density. Furthermore, we propose a technique to determine the optimal choice of interconnect for any given DNN. In this technique, we use analytical models of NoC to evaluate end-to-end communication latency of any given DNN. We demonstrate that the interconnect optimization in the IMC architecture results in up to 6$\times$ improvement in energy-delay-area product for VGG-19 inference compared to the state-of-the-art ReRAM-based IMC architectures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑