arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.14838cs.AIcs.AR
收藏

MICSim:用于混合信号存内计算AI加速器的模块化模拟器

MICSim: A Modular Simulator for Mixed-signal Compute-in-Memory based AI Accelerator

The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))

Cong Wang, Zeming Chen, Shanshi Huang

AI总结:

MICSim是一个模块化、开源的电路前模拟器,用于混合信号CIM加速器的早期评估,支持多级协同设计,并比NeuroSim快9-32倍。

摘要:

这项工作介绍了MICSim,一个开源的、电路前端的模拟器,用于混合信号存内计算(CIM)加速器的芯片级软件性能和硬件开销的早期评估。MICSim具有模块化设计,便于进行多级协同设计和设计空间探索。MICSim从最先进的CIM模拟器NeuroSim模块化而来,提供了一个高度可配置的模拟框架,支持多种量化算法、多样的电路/架构设计以及不同的存储器件。这种模块化方法还使MICSim能够有效地扩展以适应新的设计。MICSim原生支持在Python中评估CNN和Transformer的加速器软件和硬件性能,利用流行的PyTorch和HuggingFace Transformers框架。这些能力使MICSim在模拟不同网络时具有高度适应性,并且用户友好。这项工作证明了MICSim可以轻松地与优化策略结合进行设计空间探索,并用于芯片级Transformer CIM加速器评估。此外,通过这项工作提出的基于统计的平均模式,MICSim可以实现比NeuroSim快9倍至32倍的速度提升。

英文摘要:

This work introduces MICSim, an open-source, pre-circuit simulator designed for early-stage evaluation of chip-level software performance and hardware overhead of mixed-signal compute-in-memory (CIM) accelerators. MICSim features a modular design, allowing easy multi-level co-design and design space exploration. Modularized from the state-of-the-art CIM simulator NeuroSim, MICSim provides a highly configurable simulation framework supporting multiple quantization algorithms, diverse circuit/architecture designs, and different memory devices. This modular approach also allows MICSim to be effectively extended to accommodate new designs. MICSim natively supports evaluating accelerators' software and hardware performance for CNNs and Transformers in Python, leveraging the popular PyTorch and HuggingFace Transformers frameworks. These capabilities make MICSim highly adaptive when simulating different networks and user-friendly. This work demonstrates that MICSim can easily be combined with optimization strategies to perform design space exploration and used for chip-level Transformers CIM accelerators evaluation. Also, MICSim can achieve a 9x - 32x speedup of NeuroSim through a statistic-based average mode proposed by this work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑