IMPULSE:一个65 nm数字内存计算宏,融合权重和膜电位,用于基于尖峰的顺序学习任务
IMPULSE: A 65nm Digital Compute-in-Memory Macro with Fused Weights and Membrane Potential for Spike-based Sequential Learning Tasks
摘要:
脉冲神经网络(SNN)中神经元膜电位的固有动力学允许处理顺序学习任务,避免了递归神经网络的复杂性。这种时空数据中的高度稀疏的基于尖峰的计算可以用于能量效率。然而,膜电位在当前SNN硬件中引起额外的存储器访问瓶颈。为此,我们提出了一个10 T-SRAM内存计算(CIM)宏,专门为国家的最先进的SNN推理。它由一个融合的重量(WMEM)和膜电位(VMEM)的内存和固有的利用稀疏性输入尖峰导致97.4%的减少能量延迟产品(EDP)在85%的稀疏性(典型的SNN考虑在这项工作中)相比,没有稀疏的情况下。我们提出了交错的数据映射和可重新配置的外设,用于处理WMEM和VMEM的不同位精度要求,同时支持多个神经元功能。该宏采用65 nm CMOS工艺制造,在0.85V电源电压和200 MHz频率下,实现了0.99TOPS/W的有符号11位操作的能量效率。我们从IMDB电影评论数据集评估了SNN的情感分类,并以8.5倍的低参数实现了LSTM网络的1%精度。
英文摘要:
The inherent dynamics of the neuron membrane potential in Spiking Neural Networks (SNNs) allows processing of sequential learning tasks, avoiding the complexity of recurrent neural networks. The highly-sparse spike-based computations in such spatio-temporal data can be leveraged for energy-efficiency. However, the membrane potential incurs additional memory access bottlenecks in current SNN hardware. To that effect, we propose a 10T-SRAM compute-in-memory (CIM) macro, specifically designed for state-of-the-art SNN inference. It consists of a fused weight (WMEM) and membrane potential (VMEM) memory and inherently exploits sparsity in input spikes leading to 97.4% reduction in energy-delay-product (EDP) at 85% sparsity (typical of SNNs considered in this work) compared to the case of no sparsity. We propose staggered data mapping and reconfigurable peripherals for handling different bit-precision requirements of WMEM and VMEM, while supporting multiple neuron functionalities. The proposed macro was fabricated in 65nm CMOS technology, achieving an energy-efficiency of 0.99TOPS/W at 0.85V supply and 200MHz frequency for signed 11-bit operations. We evaluate the SNN for sentiment classification from the IMDB dataset of movie reviews and achieve within 1% accuracy of an LSTM network with 8.5x lower parameters.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。