混合精度存内计算
Mixed-Precision In-Memory Computing
摘要:
随着CMOS规模达到其技术极限,需要从传统的冯诺依曼系统(涉及单独的处理和存储单元)中彻底脱离,以显着扩展当今计算机的性能。存内计算是一种很有前途的方法,其中组织在计算存储单元中的纳米级电阻式存储器件用于处理和存储。然而,为了达到数据分析和科学计算通常所需的数值精度,需要解决由设备可变性和非理想设备特性引起的限制。在这里,我们介绍了混合精度存内计算的概念,它结合了冯诺依曼机与计算存储单元。在这个混合系统中,计算存储器单元执行大量的计算任务,而冯·诺依曼机实现了一个向后的方法来迭代地提高解决方案的准确性。因此,该系统受益于数字计算的高精度和存内计算的能量/面积效率。我们通过精确求解线性方程组,特别是使用998,752个相变存储器设备的5,000个方程的系统,实验证明了该方法的有效性。
英文摘要:
As CMOS scaling reaches its technological limits, a radical departure from traditional von Neumann systems, which involve separate processing and memory units, is needed in order to significantly extend the performance of today's computers. In-memory computing is a promising approach in which nanoscale resistive memory devices, organized in a computational memory unit, are used for both processing and memory. However, to reach the numerical accuracy typically required for data analytics and scientific computing, limitations arising from device variability and non-ideal device characteristics need to be addressed. Here we introduce the concept of mixed-precision in-memory computing, which combines a von Neumann machine with a computational memory unit. In this hybrid system, the computational memory unit performs the bulk of a computational task, while the von Neumann machine implements a backward method to iteratively improve the accuracy of the solution. The system therefore benefits from both the high precision of digital computing and the energy/areal efficiency of in-memory computing. We experimentally demonstrate the efficacy of the approach by accurately solving systems of linear equations, in particular, a system of 5,000 equations using 998,752 phase-change memory devices.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。