arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.06171cs.CVcs.LGcs.RO
收藏

基于梯度匹配的损失蒸馏用于加权 Chamfer 距离点云补全

Loss Distillation via Gradient Matching for Point Cloud Completion with Weighted Chamfer Distance

Graduate School of Information Sciences, Tohoku University(东北大学信息科学研究生院);Worcester Polytechnic Institute(伍斯特理工学院);Dell Technologies(戴尔科技公司)

Fangzhou Lin, Haotian Liu, Haoying Zhou, Songlin Hou, Kazunori D Yamada, Gregory S. Fischer, Yanhua Li, Haichong K. Zhang, Ziming Zhang

AI总结:

针对点云补全中 CD 损失参数调优耗时的问题,提出梯度匹配损失蒸馏搜索无需调参的加权 CD,并通过双层优化训练,Landau CD 在多个基准上达到最先进水平。

摘要:

3D点云增强了机器人感知环境几何信息的能力,使抓取姿态检测和场景理解等许多下游任务成为可能。然而,这些任务的性能严重依赖输入数据的质量,因为不完整的数据会导致较差的结果和失败案例。近期为基于深度学习的点云补全设计的训练损失函数,例如 Chamfer 距离(CD)及其变体(如 HyperCD),表明良好的梯度加权方案可以显著提升性能。但是,这些基于 CD 的损失函数通常需要进行与数据相关的参数调优,对于数据量庞大的任务而言非常耗时。为解决这一问题,本文旨在寻找一族无需参数调优的加权训练损失(加权 CD)。为此,我们提出一种搜索方案——基于梯度匹配的损失蒸馏,通过模仿 HyperCD 与加权 CD 之间反向传播中的学习行为来寻找优良的候选损失函数。在此基础上,我们提出一种新的双层优化公式,以基于加权 CD 损失训练骨干网络。我们观察到:(1)借助适当的加权函数,加权 CD 始终能够取得与 HyperCD 相近的性能;(2)Landau 加权 CD(即 Landau CD)在点云补全上可以超越 HyperCD,并在多个基准数据集上取得新的最先进结果。我们的演示代码可在 https://github.com/Zhang-VISLab/IROS2024-LossDistillationWeightedCD 获取。

英文摘要:

3D point clouds enhanced the robot's ability to perceive the geometrical information of the environments, making it possible for many downstream tasks such as grasp pose detection and scene understanding. The performance of these tasks, though, heavily relies on the quality of data input, as incomplete can lead to poor results and failure cases. Recent training loss functions designed for deep learning-based point cloud completion, such as Chamfer distance (CD) and its variants (\eg HyperCD ), imply a good gradient weighting scheme can significantly boost performance. However, these CD-based loss functions usually require data-related parameter tuning, which can be time-consuming for data-extensive tasks. To address this issue, we aim to find a family of weighted training losses ({\em weighted CD}) that requires no parameter tuning. To this end, we propose a search scheme, {\em Loss Distillation via Gradient Matching}, to find good candidate loss functions by mimicking the learning behavior in backpropagation between HyperCD and weighted CD. Once this is done, we propose a novel bilevel optimization formula to train the backbone network based on the weighted CD loss. We observe that: (1) with proper weighted functions, the weighted CD can always achieve similar performance to HyperCD, and (2) the Landau weighted CD, namely {\em Landau CD}, can outperform HyperCD for point cloud completion and lead to new state-of-the-art results on several benchmark datasets. {\it Our demo code is available at \url{https://github.com/Zhang-VISLab/IROS2024-LossDistillationWeightedCD}.}

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑