arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2307.05409cs.CVastro-ph.IMcs.AI
收藏

基于单张卫星影像的屋顶截面3D检测及其在LOD2建筑重建中的应用

3D detection of roof sections from a single satellite image and application to LOD2-building reconstruction

INRIA Sophia Antipolis Méditerrannée(法国国家信息与自动化研究所索菲亚·安提波利斯地中海研究中心);LuxCarta Technology(LuxCarta科技公司)

Johann Lussange, Mulin Yu, Yuliya Tarabalka, Florent Lafarge

AI总结:

提出KIBS方法,仅用单张非正射卫星影像,通过两个Mask R-CNN依次完成屋顶截面2D分割与角点高度推理,实现LOD2级城市3D重建。

摘要:

从卫星栅格影像中对城市区域进行3D重建,长期以来一直是学术和工业研究中一个具有挑战性的目标。如今,能够在细节层次2(Level Of Details 2,LOD2)实现这一目标的方法较为稀少,它们依赖于基于几何的过程化方法,并需要立体影像和/或LIDAR数据作为输入。本文提出一种名为KIBS(Keypoints Inference By Segmentation,基于分割的关键点推理)的城市3D重建方法,该方法包含两个新颖特征:i)用于屋顶截面3D检测的完全深度学习方法;ii)仅将单张(非正射)卫星栅格影像作为模型输入。这通过两个步骤实现:i)由一个Mask R-CNN模型对建筑屋顶截面执行2D分割,并将这些分割出的像素融合到RGB卫星栅格影像中;ii)由另一个相同的Mask R-CNN模型通过全景分割推理屋顶截面角点距地面的高度,进而实现建筑和城市的完整3D重建。我们通过在数分钟内重建不同城市区域展示了KIBS方法的潜力:在两个数据集上,单个屋顶截面2D分割的Jaccard指数分别为88.55%和75.21%;在两个数据集上,此类正确分割像素用于3D重建的高度平均误差分别为1.60 m和2.06 m,因此处于LOD2精度范围内。

英文摘要:

Reconstructing urban areas in 3D out of satellite raster images has been a long-standing and challenging goal of both academical and industrial research. The rare methods today achieving this objective at a Level Of Details $2$ rely on procedural approaches based on geometry, and need stereo images and/or LIDAR data as input. We here propose a method for urban 3D reconstruction named KIBS(\textit{Keypoints Inference By Segmentation}), which comprises two novel features: i) a full deep learning approach for the 3D detection of the roof sections, and ii) only one single (non-orthogonal) satellite raster image as model input. This is achieved in two steps: i) by a Mask R-CNN model performing a 2D segmentation of the buildings' roof sections, and after blending these latter segmented pixels within the RGB satellite raster image, ii) by another identical Mask R-CNN model inferring the heights-to-ground of the roof sections' corners via panoptic segmentation, unto full 3D reconstruction of the buildings and city. We demonstrate the potential of the KIBS method by reconstructing different urban areas in a few minutes, with a Jaccard index for the 2D segmentation of individual roof sections of $88.55\%$ and $75.21\%$ on our two data sets resp., and a height's mean error of such correctly segmented pixels for the 3D reconstruction of $1.60$ m and $2.06$ m on our two data sets resp., hence within the LOD2 precision range.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑