FPSA:一种可重构ReRAM-based NN加速器体系结构的全系统栈解决方案
FPSA: A Full System Stack Solution for Reconfigurable ReRAM-based NN Accelerator Architecture
摘要:
由于\textit{processing-in-memory}在基于ReRAM交叉开关的处理元件(PE)内的独特能力,具有新兴ReRAM(电阻式随机存取存储器)技术的神经网络(NN)加速器已经被研究为解决\textit{memory wall}挑战的有前景的解决方案之一。然而,由于PE之间巨大的通信需求和外围电路的开销,ReRAM的高效率和高密度优势尚未得到充分利用。在本文中,我们提出了一个完整的系统堆栈解决方案,由一个可重构的架构设计,现场可编程突触阵列(FPSA)和它的软件系统,包括神经合成器,时空映射器,布局和路由。我们高度利用软件系统,使硬件设计紧凑和高效。为了满足高性能的通信需求,我们优化它与可重构的布线结构和布局和布线工具。为了提高计算密度,我们大大简化了PE电路与尖峰模式,然后采用神经合成器,使高密度的计算资源,以支持不同种类的神经网络操作。此外,我们在硬件中提供尖峰存储块(SMB)和可配置逻辑块(CLB),并利用时间到空间映射器来利用它们来平衡NN的存储和计算需求。由于端到端的软件系统,我们可以有效地将现有的深度神经网络部署到FPSA。评估表明,与最先进的基于ReRAM的NN加速器之一PRIME相比,FPSA的计算密度提高了31倍;对于代表性的NN,其推理性能可以实现高达1000倍的加速比。
英文摘要:
Neural Network (NN) accelerators with emerging ReRAM (resistive random access memory) technologies have been investigated as one of the promising solutions to address the \textit{memory wall} challenge, due to the unique capability of \textit{processing-in-memory} within ReRAM-crossbar-based processing elements (PEs). However, the high efficiency and high density advantages of ReRAM have not been fully utilized due to the huge communication demands among PEs and the overhead of peripheral circuits. In this paper, we propose a full system stack solution, composed of a reconfigurable architecture design, Field Programmable Synapse Array (FPSA) and its software system including neural synthesizer, temporal-to-spatial mapper, and placement & routing. We highly leverage the software system to make the hardware design compact and efficient. To satisfy the high-performance communication demand, we optimize it with a reconfigurable routing architecture and the placement & routing tool. To improve the computational density, we greatly simplify the PE circuit with the spiking schema and then adopt neural synthesizer to enable the high density computation-resources to support different kinds of NN operations. In addition, we provide spiking memory blocks (SMBs) and configurable logic blocks (CLBs) in hardware and leverage the temporal-to-spatial mapper to utilize them to balance the storage and computation requirements of NN. Owing to the end-to-end software system, we can efficiently deploy existing deep neural networks to FPSA. Evaluations show that, compared to one of state-of-the-art ReRAM-based NN accelerators, PRIME, the computational density of FPSA improves by 31x; for representative NNs, its inference performance can achieve up to 1000x speedup.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。