arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.02246cs.CV
收藏

One Thing One Click:一种弱监督三维语义分割的自训练方法

One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation

The Chinese University of Hong Kong(香港中文大学);The University of Hong Kong(香港大学)

Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu

摘要:

点云语义分割通常需要大规模带注释的训练数据,但显然,逐点标记太繁琐而无法准备。虽然最近的一些方法建议用小百分比的点标签来训练3D网络,但我们将这种方法推向了极端,提出了“One Thing One Click”,这意味着注释器只需要为每个对象标记一个点。为了在网络训练中利用这些极其稀疏的标签,我们设计了一种新的自训练方法,在该方法中,我们迭代地进行训练和标签传播,并通过图形传播模块进行促进。此外,我们采用关系网络来生成每个类别的原型,并显式地建模图节点之间的相似性,以生成伪标签来指导迭代训练。在ScanNet-v2和S3 DIS上的实验结果表明,我们的自训练方法,具有极稀疏的注释,优于所有现有的弱监督方法的3D语义分割的大幅度,我们的结果也可以与完全监督的同行。

英文摘要:

Point cloud semantic segmentation often requires largescale annotated training data, but clearly, point-wise labels are too tedious to prepare. While some recent methods propose to train a 3D network with small percentages of point labels, we take the approach to an extreme and propose "One Thing One Click," meaning that the annotator only needs to label one point per object. To leverage these extremely sparse labels in network training, we design a novel self-training approach, in which we iteratively conduct the training and label propagation, facilitated by a graph propagation module. Also, we adopt a relation network to generate per-category prototype and explicitly model the similarity among graph nodes to generate pseudo labels to guide the iterative training. Experimental results on both ScanNet-v2 and S3DIS show that our self-training approach, with extremely-sparse annotations, outperforms all existing weakly supervised methods for 3D semantic segmentation by a large margin, and our results are also comparable to those of the fully supervised counterparts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑