arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.14263cs.AR
收藏

可扩展且支持RISC-V编程的边缘节点近内存计算架构

Scalable and RISC-V Programmable Near-Memory Computing Architectures for Edge Nodes

Michele Caon, Clément Choné, Pasquale Davide Schiavone, Alexandre Levisse, Guido Masera, Maurizio Martina, David Atienza

AI总结:

针对边缘节点能效瓶颈,提出软件友好、低集成难度的近内存计算架构NM-Caesar与NM-Carus,相比RISC-V CPU显著降低执行时间并提升能效,NM-Carus峰值能效达306.7 GOPS/W。

摘要:

数据密集型算法,特别是人工智能(AI)和机器学习(ML)的广泛采用,暴露了集中式处理基础设施的局限性,推动了向边缘计算的转变。这对能源效率提出了严格的要求,而传统的冯·诺依曼架构难以满足这些要求。计算内存(CIM)范式因其对可用内存带宽的高效利用而成为更优的候选方案。然而,现有的CIM解决方案需要较高的实现工作量,并且从软件集成的角度来看缺乏灵活性。这项工作提出了一种新颖的、软件友好的、通用的、低集成工作量的近内存计算(NMC)方法,为CIM系统在下一代边缘计算节点中的采用铺平了道路。提出了两种架构变体NM-Caesar和NM-Carus,并对其进行了特性化,以针对面积效率、性能和灵活性之间的不同权衡,覆盖广泛的嵌入式微控制器。布局后仿真显示,与在最先进的RISC-V CPU(RV32IMC)上执行相同任务相比,系统级执行时间分别降低了高达$28.0\ imes$和$53.9\ imes$,能效分别提高了$25.0\ imes$和$35.6\ imes$。NM-Carus在8位矩阵乘法中实现了$306.7$ GOPS/W的峰值能效,超越了近期最先进的存内和近内存电路。

英文摘要:

The widespread adoption of data-centric algorithms, particularly Artificial Intelligence (AI) and Machine Learning (ML), has exposed the limitations of centralized processing infrastructures, driving a shift towards edge computing. This necessitates stringent constraints on energy efficiency, which traditional von Neumann architectures struggle to meet. The Compute-In-Memory (CIM) paradigm has emerged as a superior candidate due to its efficient exploitation of available memory bandwidth. However, existing CIM solutions require high implementation effort and lack flexibility from a software integration standpoint. This work proposes a novel, software-friendly, general-purpose, and low-integration-effort Near-Memory Computing (NMC) approach, paving the way for the adoption of CIM-based systems in the next generation of edge computing nodes. Two architectural variants, NM-Caesar and NM-Carus, are proposed and characterized to target different trade-offs in area efficiency, performance, and flexibility, covering a wide range of embedded microcontrollers. Post-layout simulations show up to $28.0\times$ and $53.9\times$ lower execution time and $25.0\times$ and $35.6\times$ higher energy efficiency at the system level, respectively, compared to executing the same tasks on a state-of-the-art RISC-V CPU (RV32IMC). NM-Carus achieves a peak energy efficiency of $306.7$ GOPS/W in 8-bit matrix multiplications, surpassing recent state-of-the-art in- and near-memory circuits.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑