arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.07409cs.CV
收藏

EfficientNet-eLite:基于网络候选搜索的边缘设备极轻量高效CNN模型

EfficientNet-eLite: Extremely Lightweight and Efficient CNN Models for Edge Devices by Network Candidate Search

National Tsing Hua University(台湾清华大学)

Ching-Chen Wang, Ching-Te Chiu, Jheng-Yi Chang

摘要:

将卷积神经网络(CNN)嵌入到边缘设备中进行推理是一项非常具有挑战性的任务,因为这种轻量级的硬件并不是生来就能处理这种重量级软件的,这是现代最先进的CNN模型的常见开销。在本文中,旨在减少开销与交易的准确性尽可能少,我们提出了一种新的网络候选人搜索(NCS),一种替代的方式来研究之间的权衡资源使用和性能通过分组的概念和淘汰赛。此外,NCS还可以推广到任何神经网络。在我们的实验中,我们从EfficientNet-B 0中收集候选CNN模型,通过宽度,深度,输入分辨率和复合缩放的不同方式进行缩放,应用NCS研究缩放权衡。同时,得到了一个非常轻量级的EfficientNet族,称为EfficientNet-eLite。为了进一步利用专用集成电路(ASIC)来拥抱CNN边缘应用,我们调整了EfficientNet-eLite的架构,以构建更硬件友好的版本EfficientNet-HF。在ImageNet数据集上进行的评估表明,提出的EfficientNet-eLite和EfficientNet-HF都比以前的最先进CNN具有更好的参数使用和准确性。特别是,EfficientNet-eLite的最小成员比现有的最好和最小的MnasNet更轻量级,参数少1.46倍,精度高0.56%。代码可在https://github.com/Ching-Chen-Wang/EfficientNet-eLite上获得

英文摘要:

Embedding Convolutional Neural Network (CNN) into edge devices for inference is a very challenging task because such lightweight hardware is not born to handle this heavyweight software, which is the common overhead from the modern state-of-the-art CNN models. In this paper, targeting at reducing the overhead with trading the accuracy as less as possible, we propose a novel of Network Candidate Search (NCS), an alternative way to study the trade-off between the resource usage and the performance through grouping concepts and elimination tournament. Besides, NCS can also be generalized across any neural network. In our experiment, we collect candidate CNN models from EfficientNet-B0 to be scaled down in varied way through width, depth, input resolution and compound scaling down, applying NCS to research the scaling-down trade-off. Meanwhile, a family of extremely lightweight EfficientNet is obtained, called EfficientNet-eLite. For further embracing the CNN edge application with Application-Specific Integrated Circuit (ASIC), we adjust the architectures of EfficientNet-eLite to build the more hardware-friendly version, EfficientNet-HF. Evaluation on ImageNet dataset, both proposed EfficientNet-eLite and EfficientNet-HF present better parameter usage and accuracy than the previous start-of-the-art CNNs. Particularly, the smallest member of EfficientNet-eLite is more lightweight than the best and smallest existing MnasNet with 1.46x less parameters and 0.56% higher accuracy. Code is available at https://github.com/Ching-Chen-Wang/EfficientNet-eLite

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑