arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.06537cs.CV
收藏

OccuSeg:占用感知的3D实例分割

OccuSeg: Occupancy-aware 3D Instance Segmentation

Tsinghua University(清华大学);Hong Kong University of Science and Technology(香港科技大学)

Lei Han, Tian Zheng, Lan Xu, Lu Fang

摘要:

3D实例分割在机器人技术和增强现实中有着广泛的应用,目前需求量很大。与作为环境的投影观测的2D图像不同,3D模型提供场景的度量重建,而没有遮挡或尺度模糊。在本文中,我们定义“3D占用大小”,作为每个实例所占用的体素的数量。在此基础上,提出了一种基于占用感知的三维实例分割算法OccupSeg。我们的多任务学习产生占用信号和嵌入表示,其中空间和特征嵌入的训练随着它们在尺度感知方面的差异而变化。我们的聚类方案受益于预测占用大小和聚类占用大小之间的可靠比较,这鼓励硬样本被正确聚类,避免过度分割。该方法在ScanNetV2、S3DIS和SceneNN 3个真实数据集上实现了最先进的性能,同时保持了高效率。

英文摘要:

3D instance segmentation, with a variety of applications in robotics and augmented reality, is in large demands these days. Unlike 2D images that are projective observations of the environment, 3D models provide metric reconstruction of the scenes without occlusion or scale ambiguity. In this paper, we define "3D occupancy size", as the number of voxels occupied by each instance. It owns advantages of robustness in prediction, on which basis, OccuSeg, an occupancy-aware 3D instance segmentation scheme is proposed. Our multi-task learning produces both occupancy signal and embedding representations, where the training of spatial and feature embeddings varies with their difference in scale-aware. Our clustering scheme benefits from the reliable comparison between the predicted occupancy size and the clustered occupancy size, which encourages hard samples being correctly clustered and avoids over segmentation. The proposed approach achieves state-of-the-art performance on 3 real-world datasets, i.e. ScanNetV2, S3DIS and SceneNN, while maintaining high efficiency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑