arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2002.07689cs.CV
收藏

基于体素的HoloLens三角形网格室内重建

Voxel-Based Indoor Reconstruction From HoloLens Triangle Meshes

Karlsruhe Institute of Technology (KIT)(卡尔斯鲁厄理工学院)

P. Hübner, M. Weinmann, S. Wursthorn

摘要:

当前的移动增强现实设备通常配备有距离传感器。例如,微软HoloLens配备了一个飞行时间(ToF)范围摄像头,提供可用于自定义应用的粗糙三角形网格。我们建议使用三角形网格的自动生成的室内模型,可以作为增强其物理对应与位置相关的信息的基础。在本文中,我们提出了一种新的基于体素的方法,从非结构化的三维几何形状,如三角形网格的自动室内重建。在输入数据的初始体素化之后,通过分割天花板候选者的连接体素分量并将它们向下挤压以找到地板候选者,在所得体素网格中检测房间。然后,通过基于规则的体素扫描算法,将语义类标签(如“墙”、“墙洞口”、“室内对象”和“空室内”)分配给天花板和地板之间的房间体素。最后,在体素表示中细化检测到的壁及其开口的几何形状。所提出的方法不限于曼哈顿世界的情况下,不依赖于房间表面是平面的。

英文摘要:

Current mobile augmented reality devices are often equipped with range sensors. The Microsoft HoloLens for instance is equipped with a Time-Of-Flight (ToF) range camera providing coarse triangle meshes that can be used in custom applications. We suggest to use the triangle meshes for the automatic generation of indoor models that can serve as basis for augmenting their physical counterpart with location-dependent information. In this paper, we present a novel voxel-based approach for automated indoor reconstruction from unstructured three-dimensional geometries like triangle meshes. After an initial voxelization of the input data, rooms are detected in the resulting voxel grid by segmenting connected voxel components of ceiling candidates and extruding them downwards to find floor candidates. Semantic class labels like 'Wall', 'Wall Opening', 'Interior Object' and 'Empty Interior' are then assigned to the room voxels in-between ceiling and floor by a rule-based voxel sweep algorithm. Finally, the geometry of the detected walls and their openings is refined in voxel representation. The proposed approach is not restricted to Manhattan World scenarios and does not rely on room surfaces being planar.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑