计数卡:利用方差和数据分布实现强大的内存计算
Counting Cards: Exploiting Variance and Data Distributions for Robust Compute In-Memory
摘要:
内存计算(CIM)是一种很有前途的技术,它可以最大限度地减少数据传输,这是大多数数据密集型应用程序的主要性能瓶颈和能源成本。这在加速机器学习应用的神经网络中得到了广泛的采用。利用具有诸如密集电阻式随机存取存储器(RRAM)或相变随机存取存储器(PCRAM)之类的新兴非易失性存储器(eNVM)的交叉开关架构,可以实现各种形式的神经网络以大大降低功率并增加片上存储器容量。然而,内存计算在电路和设备层面都面临着自身的局限性。在这项工作中,我们探讨了设备的变化和外围电路设计的限制的影响。此外,我们提出了一种新的算法,基于设备方差和神经网络的权重分布,以提高性能和精度的计算内存为基础的设计。我们展示了27%的功率提高和23%的性能提高低和高方差eNVM,同时满足可编程阈值的目标容错,这取决于应用程序。
英文摘要:
Compute in-memory (CIM) is a promising technique that minimizes data transport, the primary performance bottleneck and energy cost of most data intensive applications. This has found wide-spread adoption in accelerating neural networks for machine learning applications. Utilizing a crossbar architecture with emerging non-volatile memories (eNVM) such as dense resistive random access memory (RRAM) or phase change random access memory (PCRAM), various forms of neural networks can be implemented to greatly reduce power and increase on chip memory capacity. However, compute in-memory faces its own limitations at both the circuit and the device levels. In this work, we explore the impact of device variation and peripheral circuit design constraints. Furthermore, we propose a new algorithm based on device variance and neural network weight distributions to increase both performance and accuracy for compute-in memory based designs. We demonstrate a 27% power improvement and 23% performance improvement for low and high variance eNVM, while satisfying a programmable threshold for a target error tolerance, which depends on the application.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。