CHIME:基于STT-RAM的高能效并发分层内存内处理
CHIME: Energy-Efficient STT-RAM-based Concurrent Hierarchical In-Memory Processing
AI总结:
本文提出基于STT-RAM的并发分层内存内处理架构CHIME,通过在内存层次多级集成异构计算单元,实现57.95%加速和78.23%节能。
摘要:
缓存内处理(PiC)和内存内处理(PiM)架构,特别是那些利用位线计算的架构,为缓解内存层次结构内的数据移动瓶颈提供了有前景的解决方案。虽然先前的研究已经探索了在单个内存层级中集成计算单元,但这些设计相关的复杂性和潜在开销往往限制了它们的能力。本文提出了一种新颖的PiC/PiM架构,即并发分层内存内处理(CHIME),它在内存层次结构的多个层级中战略性地集成了异构计算单元。该设计旨在通过将计算放置在最接近数据的位置来高效执行各种特定领域的工作负载,从而优化性能、能耗、数据移动成本和面积。CHIME采用STT-RAM,因为它在PiC/PiM计算中具有高密度、低泄漏以及对多字线激活导致的数据损坏具有更好恢复力等优势。我们证明CHIME增强了并发性,并提高了内存层次结构每个层级中计算单元的利用率。我们提出了探索设计空间、分组和放置计算单元在内存层次结构中的策略。实验表明,与最先进的位线计算方法相比,CHIME在各种特定领域工作负载上实现了57.95%的显著加速和78.23%的能耗节省,同时减少了与单级计算设计相关的开销。
英文摘要:
Processing-in-cache (PiC) and Processing-in-memory (PiM) architectures, especially those utilizing bit-line computing, offer promising solutions to mitigate data movement bottlenecks within the memory hierarchy. While previous studies have explored the integration of compute units within individual memory levels, the complexity and potential overheads associated with these designs have often limited their capabilities. This paper introduces a novel PiC/PiM architecture, Concurrent Hierarchical In-Memory Processing (CHIME), which strategically incorporates heterogeneous compute units across multiple levels of the memory hierarchy. This design targets the efficient execution of diverse, domain-specific workloads by placing computations closest to the data where it optimizes performance, energy consumption, data movement costs, and area. CHIME employs STT-RAM due to its various advantages in PiC/PiM computing, such as high density, low leakage, and better resiliency to data corruption from activating multiple word lines. We demonstrate that CHIME enhances concurrency and improves compute unit utilization at each level of the memory hierarchy. We present strategies for exploring the design space, grouping, and placing the compute units across the memory hierarchy. Experiments reveal that, compared to the state-of-the-art bit-line computing approaches, CHIME achieves significant speedup and energy savings of 57.95% and 78.23% for various domain-specific workloads, while reducing the overheads associated with single-level compute designs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。