arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2202.08604cs.CVcs.AI
收藏

图像分类中使用早期停止的神经结构搜索的两阶段结构微调

Two-stage architectural fine-tuning with neural architecture search using early-stopping in image classification

Korea University(高丽大学);Hongik University(弘益大学);Ajou University(亚洲大学)

Youngkee Kim, Won Joon Yun, Youn Kyu Lee, Soyi Jung, Joongheon Kim

摘要:

在许多深度神经网络(DNN)应用中,行业领域高质量数据的采集难度阻碍了DNN的实用化。因此,出现了迁移学习的概念,它利用了在大规模数据集上训练的DNN的预训练知识。因此,本文建议两阶段的架构微调,神经架构搜索(NAS)的启发。其主要思想之一是变异,它使用给定的结构信息来降低搜索成本。此外,提前停止被认为是通过提前终止搜索过程来降低NAS成本。实验结果表明,该方法减少了32.4%的计算量和22.3%的搜索量。

英文摘要:

In many deep neural network (DNN) applications, the difficulty of gathering high-quality data in the industry field hinders the practical use of DNN. Thus, the concept of transfer learning has emerged, which leverages the pretrained knowledge of DNNs trained on large-scale datasets. Therefore, this paper suggests two-stage architectural fine-tuning, inspired by neural architecture search (NAS). One of main ideas is mutation, which reduces the search cost using given architectural information. Moreover, early-stopping is considered which cuts NAS costs by terminating the search process in advance. Experimental results verify our proposed method reduces 32.4% computational and 22.3% searching costs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑