arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1901.06403cs.CV
收藏

基于多尺度区域注意力网络的遥感图像细粒度目标识别

Multisource Region Attention Network for Fine-Grained Object Recognition in Remote Sensing Imagery

Bilkent University(比尔肯特大学);TU Berlin(柏林工业大学);METU(中东技术大学)

Gencer Sumbul, Ramazan Gokberk Cinbis, Selim Aksoy

摘要:

细粒度对象识别涉及在大量密切相关的子类别中识别对象的类型。多光谱数据分析旨在利用嵌入在不同来源中的互补光谱,空间和结构信息,是解决细粒度识别问题的一个有前途的方向,该问题涉及低类间方差,稀有类的小训练集大小和类不平衡。然而,共同配准源的共同假设可能不适用于感兴趣的小对象的像素级。我们提出了一种新的方法,其目的是同时学习的对齐多个数据集和分类模型在一个统一的框架。所提出的方法涉及到一个multisbrandregion注意力网络,计算每个源的特征表示,分配注意力分数的候选区域周围采样的预期对象的位置,通过使用这些表示,并通过使用一个注意力驱动的multisbrandrepresentation相结合的特征表示和注意力分数从所有来源的对象进行分类。模型的所有组件都是使用深度神经网络实现的,并以端到端的方式进行学习。使用RGB、多光谱和LiDAR高程数据对行道树进行分类的实验表明,我们的方法在18类和40类设置下分别实现了64.2%和47.3%的准确率,相对于常用的多源特征拼接方法,分别提高了13%和14.3%。

英文摘要:

Fine-grained object recognition concerns the identification of the type of an object among a large number of closely related sub-categories. Multisource data analysis, that aims to leverage the complementary spectral, spatial, and structural information embedded in different sources, is a promising direction towards solving the fine-grained recognition problem that involves low between-class variance, small training set sizes for rare classes, and class imbalance. However, the common assumption of co-registered sources may not hold at the pixel level for small objects of interest. We present a novel methodology that aims to simultaneously learn the alignment of multisource data and the classification model in a unified framework. The proposed method involves a multisource region attention network that computes per-source feature representations, assigns attention scores to candidate regions sampled around the expected object locations by using these representations, and classifies the objects by using an attention-driven multisource representation that combines the feature representations and the attention scores from all sources. All components of the model are realized using deep neural networks and are learned in an end-to-end fashion. Experiments using RGB, multispectral, and LiDAR elevation data for classification of street trees showed that our approach achieved 64.2% and 47.3% accuracies for the 18-class and 40-class settings, respectively, which correspond to 13% and 14.3% improvement relative to the commonly used feature concatenation approach from multiple sources.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑