arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2202.10705cs.CV
收藏

PointMatch:一种用于3D点云弱监督语义分割的一致性训练框架

PointMatch: A Consistency Training Framework for Weakly Supervised Semantic Segmentation of 3D Point Clouds

CUHKSZ(香港中文大学(深圳));SRIBD(深圳大数据研究院);SYSU(中山大学);HKU(香港大学);DeepWise(深睿医疗)

Yushuang Wu, Zizheng Yan, Shengcai Cai, Guanbin Li, Yizhou Yu, Xiaoguang Han, Shuguang Cui

AI总结:

针对3D点云弱监督语义分割中标签稀疏导致传播受限的问题,提出PointMatch一致性训练框架,结合数据一致性正则化与弱标签辅助,在ScanNet-v2和S3DIS上取得SOTA。

摘要:

点云语义分割通常依赖密集标注,而这既耗费精力又成本高昂,因此研究仅使用稀疏点进行标注的弱监督方案解决方案引起了广泛关注。现有工作从给定标签出发,在数据(例如点内关系)的引导下,将标签传播到高度相关但未标注的点。然而,这存在以下问题:(i)对数据信息的利用效率低下;(ii)对标签的强依赖导致在给定标注少得多时性能容易受到抑制。因此,我们提出了一个新颖框架 PointMatch,它同时立足于数据和标签,通过应用一致性正则化来充分挖掘数据本身的信息,同时利用弱标签作为辅助。通过这种方式,可以从数据和标签中学习有意义的信息以获得更好的表示学习,这也使模型对标签稀疏程度更加鲁棒。所提出的 PointMatch 简单而有效,在 ScanNet-v2 和 S3DIS 数据集上的各种弱监督方案下均达到最先进性能,尤其是在标签极其稀疏的设置下,例如在 ScanNet-v2 的 0.01% 和 0.1% 设置下分别超过 SQN 21.2% 和 17.2%。

英文摘要:

Semantic segmentation of point cloud usually relies on dense annotation that is exhausting and costly, so it attracts wide attention to investigate solutions for the weakly supervised scheme with only sparse points annotated. Existing works start from the given labels and propagate them to highly-related but unlabeled points, with the guidance of data, e.g. intra-point relation. However, it suffers from (i) the inefficient exploitation of data information, and (ii) the strong reliance on labels thus is easily suppressed when given much fewer annotations. Therefore, we propose a novel framework, PointMatch, that stands on both data and label, by applying consistency regularization to sufficiently probe information from data itself and leveraging weak labels as assistance at the same time. By doing so, meaningful information can be learned from both data and label for better representation learning, which also enables the model more robust to the extent of label sparsity. Simple yet effective, the proposed PointMatch achieves the state-of-the-art performance under various weakly-supervised schemes on both ScanNet-v2 and S3DIS datasets, especially on the settings with extremely sparse labels, e.g. surpassing SQN by 21.2% and 17.2% on the 0.01% and 0.1% setting of ScanNet-v2, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑