arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.01845cs.LGcs.AIcs.CV
收藏

NASH:面向硬件优化的机器学习模型的神经架构搜索

NASH: Neural Architecture Search for Hardware-Optimized Machine Learning Models

Jilin University(吉林大学);Delft University of Technology(代尔夫特理工大学)

Mengfei Ji, Yuchun Chang, Baolin Zhang, Zaid Al-Ars

AI总结:

针对机器学习算法需兼顾精度、吞吐量与延迟的需求,提出NASH神经架构搜索方法,含四种策略,在ImageNet上提升ResNet精度,集成FINN工具实现高吞吐量,优化精度与硬件利用率的权衡且代码开源。

摘要:

随着机器学习(ML)算法在越来越多的应用中得到部署,这些算法需要在高精度、高吞吐量和低延迟之间实现更好的权衡。本文提出了NASH(神经架构搜索硬件优化方法),这是一种将神经架构搜索应用于机器学习硬件的全新方法。借助NASH,硬件设计不仅能实现高吞吐量和低延迟,还能具备出色的精度性能。\n本文提出了四种版本的NASH策略,所有版本的精度均高于原始模型。该策略可应用于多种卷积神经网络,在众多模型操作中选择特定操作,引导训练过程向更高精度方向推进。实验结果表明,在ImageNet数据集上测试时,在ResNet18或ResNet34上应用NASH,与未使用NASH的版本相比,top-1精度最高提升3.1%,top-5精度最高提升2.2%。\n我们还将该方法集成到FINN硬件模型综合工具中,以实现方法应用和硬件模型生成的自动化。结果显示,使用FINN可达到324.5 fps的最大吞吐量。此外,NASH模型还能在精度和硬件资源利用率之间实现更优的权衡。精度-硬件(HW)帕累托曲线表明,采用四种NASH版本的模型代表了最优权衡,即在给定硬件利用率下能达到最高精度。我们的实现代码已开源,可在GitHub的https://github.com/MFJI/NASH 上公开获取。

英文摘要:

As machine learning (ML) algorithms get deployed in an ever-increasing number of applications, these algorithms need to achieve better trade-offs between high accuracy, high throughput and low latency. This paper introduces NASH, a novel approach that applies neural architecture search to machine learning hardware. Using NASH, hardware designs can achieve not only high throughput and low latency but also superior accuracy performance. We present four versions of the NASH strategy in this paper, all of which show higher accuracy than the original models. The strategy can be applied to various convolutional neural networks, selecting specific model operations among many to guide the training process toward higher accuracy. Experimental results show that applying NASH on ResNet18 or ResNet34 achieves a top 1 accuracy increase of up to 3.1% and a top 5 accuracy increase of up to 2.2% compared to the non-NASH version when tested on the ImageNet data set. We also integrated this approach into the FINN hardware model synthesis tool to automate the application of our approach and the generation of the hardware model. Results show that using FINN can achieve a maximum throughput of 324.5 fps. In addition, NASH models can also result in a better trade-off between accuracy and hardware resource utilization. The accuracy-hardware (HW) Pareto curve shows that the models with the four NASH versions represent the best trade-offs achieving the highest accuracy for a given HW utilization. The code for our implementation is open-source and publicly available on GitHub at https://github.com/MFJI/NASH.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑