arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.18841cs.NE
收藏

RNC:面向资源受限边缘设备上DNN的高效RRAM感知NAS与编译

RNC: Efficient RRAM-aware NAS and Compilation for DNNs on Resource-Constrained Edge Devices

Kam Chi Loong, Shihao Han, Sishuo Liu, Ning Lin, Zhongrui Wang

AI总结:

本文提出面向资源受限边缘设备的RRAM感知NAS与编译框架RNC,通过层划分、复制和网络打包最大化计算单元利用率,结合NSGA-II实现帕累托最优,在保证精度的同时实现了显著的加速与高资源利用率。

摘要:

存内计算(CIM)是一种新兴的计算范式,与传统的冯·诺依曼架构相比,在加速神经网络方面具有高并行性、低延迟和高能效的显著潜力。然而,现有研究主要集中在针对大规模神经网络的硬件架构与网络协同设计上,并未考虑资源约束。在本研究中,我们旨在为基于阻变随机存取存储器(RRAM)的加速器开发边缘友好的深度神经网络(DNN)。为此,我们提出了一个边缘编译和资源受限的RRAM感知神经架构搜索(NAS)框架,以搜索满足特定硬件约束的优化神经网络。我们的编译方法集成了层划分、复制和网络打包,以最大化计算单元的利用率。使用一次性神经网络方法,可以通过非支配排序遗传算法II(NSGA-II)实现帕累托最优,从而将生成的网络架构针对高精度或低延迟进行优化。与具有不同交叉阵列资源的类ISAAC框架相比,像Squeezenet和MobilenetV3 small这样移动友好型网络的编译可以实现超过80%的利用率以及超过6倍的加速。由NAS优化为速度而得到的模型实现了5倍至30倍的加速。本文的代码可在https://github.com/ArChiiii/rram_nas_comp_pack获取。

英文摘要:

Computing-in-memory (CIM) is an emerging computing paradigm, offering noteworthy potential for accelerating neural networks with high parallelism, low latency, and energy efficiency compared to conventional von Neumann architectures. However, existing research has primarily focused on hardware architecture and network co-design for large-scale neural networks, without considering resource constraints. In this study, we aim to develop edge-friendly deep neural networks (DNNs) for accelerators based on resistive random-access memory (RRAM). To achieve this, we propose an edge compilation and resource-constrained RRAM-aware neural architecture search (NAS) framework to search for optimized neural networks meeting specific hardware constraints. Our compilation approach integrates layer partitioning, duplication, and network packing to maximize the utilization of computation units. The resulting network architecture can be optimized for either high accuracy or low latency using a one-shot neural network approach with Pareto optimality achieved through the Non-dominated Sorted Genetic Algorithm II (NSGA-II). The compilation of mobile-friendly networks, like Squeezenet and MobilenetV3 small can achieve over 80% of utilization and over 6x speedup compared to ISAAC-like framework with different crossbar resources. The resulting model from NAS optimized for speed achieved 5x-30x speedup. The code for this paper is available at https://github.com/ArChiiii/rram_nas_comp_pack.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑