下一代赛道记忆中的大脑启发认知
Brain-inspired Cognition in Next Generation Racetrack Memories
摘要:
超维计算(Hyperdimensional Computing,HDC)是一种受大脑启发的新兴计算框架,它对具有数千维的向量进行操作以模拟认知。与对数字进行操作的传统计算框架不同,HDC与大脑一样,使用高维随机向量,并且能够进行一次性学习。HDC基于一组定义良好的算术运算,具有高度的容错能力。HDC的核心操作以批量逐位方式操纵HD向量,提供了许多利用并行性的机会。不幸的是,在传统的冯-诺依曼架构中,HD向量在处理器和存储器之间的连续移动会使认知任务变得非常缓慢和能量密集。硬件加速器只能略微改善相关指标。相反,使用新兴的忆阻器件,在存储器内仅部分实现HDC框架,已经报道了相当大的性能/能量增益。本文提出了一种基于赛道内存(RTM)的架构,在内存中进行和加速整个HDC框架。所提出的解决方案需要最少的附加CMOS电路,并使用跨RTM中的多个域的读取操作(称为横向读取(TR))来实现异或(XOR)和加法操作。为了最大限度地减少CMOS电路的开销,我们提出了一种基于RTM芯片的计数机制,利用TR操作和标准RTM操作。使用语言识别作为用例,与FPGA设计相比,整体运行时间和能耗分别减少了7.8倍和5.3倍。与最先进的内存实现相比,所提出的HDC系统将能耗降低了8.6倍。
英文摘要:
Hyperdimensional computing (HDC) is an emerging computational framework inspired by the brain that operates on vectors with thousands of dimensions to emulate cognition. Unlike conventional computational frameworks that operate on numbers, HDC, like the brain, uses high dimensional random vectors and is capable of one-shot learning. HDC is based on a well-defined set of arithmetic operations and is highly error-resilient. The core operations of HDC manipulate HD vectors in bulk bit-wise fashion, offering many opportunities to leverage parallelism. Unfortunately, on conventional Von-Neuman architectures, the continuous movement of HD vectors among the processor and the memory can make the cognition task prohibitively slow and energy-intensive. Hardware accelerators only marginally improve related metrics. On the contrary, only partial implementation of an HDC framework inside memory, using emerging memristive devices, has reported considerable performance/energy gains. This paper presents an architecture based on racetrack memory (RTM) to conduct and accelerate the entire HDC framework within the memory. The proposed solution requires minimal additional CMOS circuitry and uses a read operation across multiple domains in RTMs called transverse read (TR) to realize exclusive-or (XOR) and addition operations. To minimize the overhead the CMOS circuitry, we propose an RTM nanowires-based counting mechanism that leverages the TR operation and the standard RTM operations. Using language recognition as the use case demonstrates 7.8x and 5.3x reduction in the overall runtime and energy consumption compared to the FPGA design, respectively. Compared to the state-of-the-art in-memory implementation, the proposed HDC system reduces the energy consumption by 8.6x.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。