arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2204.13637cs.CV
收藏

从离地航空影像中提取建筑物足迹的学习方法

Learning to Extract Building Footprints from Off-Nadir Aerial Images

Wuhan University(武汉大学);SenseTime Research(商汤科技研究院);University of Electronic Science and Technology of China(电子科技大学);Sun Yat-Sen University(中山大学);CUHK-SenseTime joint Lab(香港中文大学-商汤科技联合实验室)

Jinwang Wang, Lingxuan Meng, Weijia Li, Wen Yang, Lei Yu, Gui-Song Xia

摘要:

从航空影像中提取建筑物足迹是利用摄影测量计算机视觉技术进行城市精确制图的关键。现有的方法主要假设建筑物的屋顶和覆盖区很好地重叠,这可能不适用于非天底航空图像,因为它们之间通常存在很大的偏移。在本文中,我们提出了一个偏移矢量学习计划,它把建筑物的足迹提取问题在离最低点图像到建筑物屋顶和其相应的“屋顶足迹”偏移矢量的实例级联合预测问题。因此,可以通过根据预测的偏移矢量平移预测的屋顶掩模来估计足迹。我们进一步提出了一个简单但有效的特征级偏移增强模块,它可以通过引入很少的额外成本来显着改进偏移向量预测。此外,本文还创建并发布了一个新的数据集,即离地航拍图像中的建筑物(BONAI)。它包含268,958个建筑实例,跨越3,300个航拍图像,具有完全注释的实例级屋顶,足迹和每个建筑物的相应偏移矢量。在BONAI数据集上的实验表明,我们的方法达到了最先进的水平,在F1得分上超过其他竞争对手3.37到7.39分。代码、数据集和训练模型可在https://github.com/jwwangchn/BONAI.git上获得。

英文摘要:

Extracting building footprints from aerial images is essential for precise urban mapping with photogrammetric computer vision technologies. Existing approaches mainly assume that the roof and footprint of a building are well overlapped, which may not hold in off-nadir aerial images as there is often a big offset between them. In this paper, we propose an offset vector learning scheme, which turns the building footprint extraction problem in off-nadir images into an instance-level joint prediction problem of the building roof and its corresponding "roof to footprint" offset vector. Thus the footprint can be estimated by translating the predicted roof mask according to the predicted offset vector. We further propose a simple but effective feature-level offset augmentation module, which can significantly refine the offset vector prediction by introducing little extra cost. Moreover, a new dataset, Buildings in Off-Nadir Aerial Images (BONAI), is created and released in this paper. It contains 268,958 building instances across 3,300 aerial images with fully annotated instance-level roof, footprint, and corresponding offset vector for each building. Experiments on the BONAI dataset demonstrate that our method achieves the state-of-the-art, outperforming other competitors by 3.37 to 7.39 points in F1-score. The codes, datasets, and trained models are available at https://github.com/jwwangchn/BONAI.git.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑