arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.08263cs.CV
收藏

可扩展的SoftGroup:点云上的3D实例分割

Scalable SoftGroup for 3D Instance Segmentation on Point Clouds

Korea Advanced Institute of Science and Technology(韩国科学技术院);Chung-Ang University(中央大学)

Thang Vu, Kookhoi Kim, Tung M. Luu, Thanh Nguyen, Junyeong Kim, Chang D. Yoo

AI总结:

本文提出可扩展的SoftGroup(及SoftGroup++)用于点云3D实例分割,通过软语义关联和背景分类减少误差,并利用八叉树k-NN加速,在多个数据集上显著提升精度和速度。

摘要:

本文考虑一种称为SoftGroup的网络,用于准确且可扩展的3D实例分割。现有的最先进方法生成硬语义预测,随后进行分组实例分割。不幸的是,由硬决策产生的错误会传播到分组中,导致预测实例与真实值之间的重叠较差,并产生大量假阳性。为解决上述问题,SoftGroup允许每个点与多个类别关联,以缓解语义预测带来的不确定性。它还通过学习将假阳性实例归类为背景来抑制它们。关于可扩展性,现有快速方法在大规模场景上需要数十秒的计算时间,这令人不满意,且远不能适用于实时应用。我们的发现是,作为分组先决条件的k-最近邻(k-NN)模块引入了计算瓶颈。SoftGroup被扩展以解决这一计算瓶颈,称为SoftGroup++。所提出的SoftGroup++通过八叉树k-NN降低时间复杂度,并通过类别感知金字塔缩放和晚期去体素化减少搜索空间。在各种室内和室外数据集上的实验结果表明了所提出的SoftGroup和SoftGroup++的有效性和通用性。它们的性能在AP50方面大幅超越最佳基线(6%至16%)。在大规模场景的数据集上,SoftGroup++相比SoftGroup平均实现了6倍的速度提升。此外,SoftGroup可以扩展以执行目标检测和全景分割,并相对于现有方法取得显著改进。源代码和训练模型可在https://github.com/thangvubk/SoftGroup获取。

英文摘要:

This paper considers a network referred to as SoftGroup for accurate and scalable 3D instance segmentation. Existing state-of-the-art methods produce hard semantic predictions followed by grouping instance segmentation results. Unfortunately, errors stemming from hard decisions propagate into the grouping, resulting in poor overlap between predicted instances and ground truth and substantial false positives. To address the abovementioned problems, SoftGroup allows each point to be associated with multiple classes to mitigate the uncertainty stemming from semantic prediction. It also suppresses false positive instances by learning to categorize them as background. Regarding scalability, the existing fast methods require computational time on the order of tens of seconds on large-scale scenes, which is unsatisfactory and far from applicable for real-time. Our finding is that the $k$-Nearest Neighbor ($k$-NN) module, which serves as the prerequisite of grouping, introduces a computational bottleneck. SoftGroup is extended to resolve this computational bottleneck, referred to as SoftGroup++. The proposed SoftGroup++ reduces time complexity with octree $k$-NN and reduces search space with class-aware pyramid scaling and late devoxelization. Experimental results on various indoor and outdoor datasets demonstrate the efficacy and generality of the proposed SoftGroup and SoftGroup++. Their performances surpass the best-performing baseline by a large margin (6\% $\sim$ 16\%) in terms of AP$_{50}$. On datasets with large-scale scenes, SoftGroup++ achieves a 6$\times$ speed boost on average compared to SoftGroup. Furthermore, SoftGroup can be extended to perform object detection and panoptic segmentation with nontrivial improvements over existing methods. The source code and trained models are available at \url{https://github.com/thangvubk/SoftGroup}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑