SpineNet:用于识别和定位的学习尺度置换骨干
SpineNet: Learning Scale-Permuted Backbone for Recognition and Localization
摘要:
卷积神经网络通常将输入图像编码为一系列具有递减分辨率的中间特征。虽然这种结构适合于分类任务,但对于需要同时识别和定位的任务(例如,目标检测)。编码器-解码器架构提出解决这一问题的解码器网络上的骨干模型设计的分类任务。在本文中,我们认为编码器-解码器架构是无效的,因为规模减少骨干产生强大的多尺度功能。我们提出了SpineNet,一个具有尺度排列中间特征和跨尺度连接的主干,它是通过神经结构搜索在目标检测任务上学习的。使用类似的构建块,SpineNet模型在各种尺度下的性能优于ResNet-FPN模型约3%的AP,同时使用的FLOP减少10-20%。特别是,SpineNet-190使用MaskR-CNN检测器实现了52.5%的AP,使用COCO上的RetinaNet检测器实现了52.1%的AP,对于单个模型,没有测试时间增强,显着优于现有技术的检测器。SpineNet可以转移到分类任务,在具有挑战性的iNaturalist细粒度数据集上实现5%的top-1精度提高。代码在:https://github.com/tensorflow/tpu/tree/master/models/official/detection。
英文摘要:
Convolutional neural networks typically encode an input image into a series of intermediate features with decreasing resolutions. While this structure is suited to classification tasks, it does not perform well for tasks requiring simultaneous recognition and localization (e.g., object detection). The encoder-decoder architectures are proposed to resolve this by applying a decoder network onto a backbone model designed for classification tasks. In this paper, we argue encoder-decoder architecture is ineffective in generating strong multi-scale features because of the scale-decreased backbone. We propose SpineNet, a backbone with scale-permuted intermediate features and cross-scale connections that is learned on an object detection task by Neural Architecture Search. Using similar building blocks, SpineNet models outperform ResNet-FPN models by ~3% AP at various scales while using 10-20% fewer FLOPs. In particular, SpineNet-190 achieves 52.5% AP with a MaskR-CNN detector and achieves 52.1% AP with a RetinaNet detector on COCO for a single model without test-time augmentation, significantly outperforms prior art of detectors. SpineNet can transfer to classification tasks, achieving 5% top-1 accuracy improvement on a challenging iNaturalist fine-grained dataset. Code is at: https://github.com/tensorflow/tpu/tree/master/models/official/detection.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。