arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.02564cs.CVcs.LGcs.MM
收藏

基于对比学习的渐进域自适应用于卫星影像中的目标检测

Progressive Domain Adaptation with Contrastive Learning for Object Detection in the Satellite Imagery

Texas State University(德克萨斯州立大学)

Debojyoti Biswas, Jelena Tešić

AI总结:

本文针对卫星影像中小而密集目标检测难题,提出结合空间金字塔池化、跨阶段部分网络、热图区域提议和图像难度自适应焦点损失的小目标检测流程,并引入对比学习与渐进域自适应生成域不变特征,在高度不平衡卫星数据集上构建首个域自适应基准,使mAP提升7.4%。

摘要:

应用于卫星和无人机影像的最先进目标检测方法在很大程度上无法识别小而密集的目标。原因之一是俯视影像内容的高变异性,这源于所捕获的地表区域以及采集条件的高变异性。另一个原因是航空影像中目标的数量和大小与消费级数据非常不同。在这项工作中,我们提出了一种小目标检测流程,通过空间金字塔池化、跨阶段部分网络、基于热图的区域提议网络,以及通过一种新颖的图像难度分数来改进特征提取过程,该分数根据图像难度自适应调整整体焦点损失度量。接下来,我们提出了一种新颖的对比学习与渐进域自适应方法,利用局部和全局组件在航空数据集之间生成域不变特征。我们展示了可以缓解在先前未见数据集上目标识别的退化。我们创建了首个使用对比学习的域自适应基准,用于具有显著域差距和大量小目标的高度不平衡卫星数据集中的目标检测任务。所提出的方法在mAP性能指标上比最佳现有技术提高了7.4%。

英文摘要:

State-of-the-art object detection methods applied to satellite and drone imagery largely fail to identify small and dense objects. One reason is the high variability of content in the overhead imagery due to the terrestrial region captured and the high variability of acquisition conditions. Another reason is that the number and size of objects in aerial imagery are very different than in the consumer data. In this work, we propose a small object detection pipeline that improves the feature extraction process by spatial pyramid pooling, cross-stage partial networks, heatmap-based region proposal network, and object localization and identification through a novel image difficulty score that adapts the overall focal loss measure based on the image difficulty. Next, we propose novel contrastive learning with progressive domain adaptation to produce domain-invariant features across aerial datasets using local and global components. We show we can alleviate the degradation of object identification in previously unseen datasets. We create a first-ever domain adaptation benchmark using contrastive learning for the object detection task in highly imbalanced satellite datasets with significant domain gaps and dominant small objects. The proposed method results in a 7.4% increase in mAP performance measure over the best state-of-art.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑