arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.07049cs.CV
收藏

面向嵌入式系统的高效和数据无关的图像分类训练管道

Towards Efficient and Data Agnostic Image Classification Training Pipeline for Embedded Systems

Intel(英特尔)

Kirill Prokofiev, Vladislav Sovrasov

摘要:

如今,基于深度学习的方法在广泛的常用数据集(ImageNet,CIFAR,SVHN,Caltech 101,SUN397等)中的图像分类任务方面取得了显着进展。SOTA在每个提到的数据集上的性能是通过根据目标数据的属性仔细调整模型架构和训练技巧来获得的。尽管这种方法可以创造学术记录,但让一个普通的数据科学家拥有足够的资源来为他在实践中遇到的每一个图像分类任务构建一个复杂的训练管道是不现实的。本文的工作重点是回顾图像分类的最新增强和正则化方法,并探索自动选择一些最重要的超参数的方法:总时期数,初始学习率值和它的时间表。有一个训练过程配备了一个轻量级的现代CNN架构(如bileNetV3或EfficientNet),足够的正则化水平和自适应数据学习率调度,我们可以实现各种下游图像分类任务的合理性能,而无需手动调整每个特定任务的参数。生成的模型计算效率高,可以使用OpenVINO工具包部署到CPU。源代码作为OpenVINO培训扩展的一部分提供(https://github.com/openvinotoolkit/training_extensions)。

英文摘要:

Nowadays deep learning-based methods have achieved a remarkable progress at the image classification task among a wide range of commonly used datasets (ImageNet, CIFAR, SVHN, Caltech 101, SUN397, etc.). SOTA performance on each of the mentioned datasets is obtained by careful tuning of the model architecture and training tricks according to the properties of the target data. Although this approach allows setting academic records, it is unrealistic that an average data scientist would have enough resources to build a sophisticated training pipeline for every image classification task he meets in practice. This work is focusing on reviewing the latest augmentation and regularization methods for the image classification and exploring ways to automatically choose some of the most important hyperparameters: total number of epochs, initial learning rate value and it's schedule. Having a training procedure equipped with a lightweight modern CNN architecture (like bileNetV3 or EfficientNet), sufficient level of regularization and adaptive to data learning rate schedule, we can achieve a reasonable performance on a variety of downstream image classification tasks without manual tuning of parameters to each particular task. Resulting models are computationally efficient and can be deployed to CPU using the OpenVINO toolkit. Source code is available as a part of the OpenVINO Training Extensions (https://github.com/openvinotoolkit/training_extensions).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑