arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.02846cs.CV
收藏

MultiScene:大规模单幅航空影像多场景识别数据集和基准

MultiScene: A Large-scale Dataset and Benchmark for Multi-scene Recognition in Single Aerial Images

German Aerospace Center(德国航空航天中心);Technical University of Munich(慕尼黑工业大学)

Yuansheng Hua, Lichao Mou, Pu Jin, Xiao Xiang Zhu

摘要:

航空景象识别是高分辨率航空影像解译的基础研究课题。在过去的几年里,大多数研究都集中在将图像分类到一个场景类别中,而在现实世界中,更常见的是一幅图像包含多个场景。因此,在本文中,我们研究了一个更实际但尚未探索的任务-在单一图像的多场景识别。为此,我们创建了一个名为MultiScene的大规模数据集,由100,000张无约束的高分辨率航拍图像组成。考虑到手动标记这些图像是非常艰巨的,我们求助于来自众包平台的低成本注释,例如,OpenStreetMap(OSM).然而,OSM数据可能会遭受不完整和不正确,这将噪声引入图像标签。为了解决这个问题,我们对14,000张图像进行了视觉检查,并纠正了它们的场景标签,产生了一个名为MultiScene-Clean的干净注释图像子集。有了它,我们可以使用干净的数据开发和评估用于多场景识别的深度网络。此外,我们提供了所有图像的众包注释,以研究带有噪声标签的网络学习。我们在MultiScene-Clean和MultiScene上使用广泛的基线模型进行实验,分别为单个图像中的多场景识别和从噪声标签中学习提供基准。为了促进进展,我们在https://gitlab.lrz.de/ai4eo/reasoning/multiscene上提供我们的数据集和训练模型。

英文摘要:

Aerial scene recognition is a fundamental research problem in interpreting high-resolution aerial imagery. Over the past few years, most studies focus on classifying an image into one scene category, while in real-world scenarios, it is more often that a single image contains multiple scenes. Therefore, in this paper, we investigate a more practical yet underexplored task -- multi-scene recognition in single images. To this end, we create a large-scale dataset, called MultiScene, composed of 100,000 unconstrained high-resolution aerial images. Considering that manually labeling such images is extremely arduous, we resort to low-cost annotations from crowdsourcing platforms, e.g., OpenStreetMap (OSM). However, OSM data might suffer from incompleteness and incorrectness, which introduce noise into image labels. To address this issue, we visually inspect 14,000 images and correct their scene labels, yielding a subset of cleanly-annotated images, named MultiScene-Clean. With it, we can develop and evaluate deep networks for multi-scene recognition using clean data. Moreover, we provide crowdsourced annotations of all images for the purpose of studying network learning with noisy labels. We conduct experiments with extensive baseline models on both MultiScene-Clean and MultiScene to offer benchmarks for multi-scene recognition in single images and learning from noisy labels for this task, respectively. To facilitate progress, we make our dataset and trained models available on https://gitlab.lrz.de/ai4eo/reasoning/multiscene.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑