arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.07259cs.AR
收藏

CiMLoop:一款灵活、准确且快速的存内计算建模工具

CiMLoop: A Flexible, Accurate, and Fast Compute-In-Memory Modeling Tool

Tanner Andrulis, Joel S. Emer, Vivienne Sze

AI总结:

针对当前CiM研究多局限于单一层面或单一设计点、缺乏全栈评估工具的问题,提出开源工具CiMLoop,通过灵活规范、精准能耗模型与快速统计模型,实现CiM全栈设计的高效评估与探索。

摘要:

存内计算(Compute-In-Memory, CiM)是加速深度神经网络(Deep Neural Networks, DNNs)的一种极具潜力的方案,因为它能够避免高能耗的DNN权重搬运,并利用存储阵列执行低能耗、高密度的计算。这些优势推动了CiM全栈各层面的研究,但当前的CiM研究往往仅聚焦于栈中的某一层面(即器件、电路、架构、工作负载或映射),或仅针对单个设计点(例如一款已流片的芯片)。目前亟需一款全栈建模工具,以在完整系统的语境下评估设计决策(例如分析某一电路对系统能耗的影响),并实现CiM协同设计空间的早期快速探索。为满足这一需求,我们提出了CiMLoop:一款用于建模各类CiM系统、探索CiM全栈各层面决策的开源工具。CiMLoop具备三大核心特性:(1)灵活的规范定义,支持用户描述、建模工作负载,并将其映射到电路与架构层面;(2)精准的能耗模型,可捕捉DNN操作数值、硬件数据表示以及电路传输的模拟/数字值之间的交互关系;(3)快速统计模型,其设计空间探索速度比其他高精度模型快数个数量级。借助CiMLoop,研究人员能够评估CiM栈不同层面的设计选择、开展跨全栈的协同设计、公平对比不同实现方案,并快速探索设计空间。

英文摘要:

Compute-In-Memory (CiM) is a promising solution to accelerate Deep Neural Networks (DNNs) as it can avoid energy-intensive DNN weight movement and use memory arrays to perform low-energy, high-density computations. These benefits have inspired research across the CiM stack, but CiM research often focuses on only one level of the stack (i.e., devices, circuits, architecture, workload, or mapping) or only one design point (e.g., one fabricated chip). There is a need for a full-stack modeling tool to evaluate design decisions in the context of full systems (e.g., see how a circuit impacts system energy) and to perform rapid early-stage exploration of the CiM co-design space. To address this need, we propose CiMLoop: an open-source tool to model diverse CiM systems and explore decisions across the CiM stack. CiMLoop introduces (1) a flexible specification that lets users describe, model, and map workloads to both circuits and architecture, (2) an accurate energy model that captures the interaction between DNN operand values, hardware data representations, and analog/digital values propagated by circuits, and (3) a fast statistical model that can explore the design space orders-of-magnitude more quickly than other high-accuracy models. Using CiMLoop, researchers can evaluate design choices at different levels of the CiM stack, co-design across all levels, fairly compare different implementations, and rapidly explore the design space.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑