arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.03807cs.CVcs.AI

GS2Pose:基于高斯溅射引导的两阶段6D物体姿态估计

GS2Pose: Two-stage 6D Object Pose Estimation Guided by Gaussian Splatting

Beihang University(北京航空航天大学)

Jilan Mei, Junbo Li, Cai Meng

AI总结:

本文提出GS2Pose,一种仅需分割RGBD图像、无需CAD模型的两阶段6D姿态估计方法,利用3D高斯溅射和姿态可微渲染实现粗到精的准确估计,在LineMod数据集上表现优异。

摘要:

本文提出了一种名为GS2Pose的新方法,用于对新颖物体进行准确且鲁棒的6D姿态估计。通过引入3D高斯溅射,GS2Pose可以利用重建结果而无需高质量的CAD模型,这意味着它仅需要分割的RGBD图像作为输入。具体来说,GS2Pose采用两阶段结构,包括粗估计和随后的精估计。在粗估计阶段,设计了一个带有极化注意力机制的轻量级U-Net网络,称为Pose-Net。通过使用3DGS模型进行监督训练,Pose-Net可以生成NOCS图像以计算粗略姿态。在精估计阶段,GS2Pose遵循重投影或束调整(BA)的思想,制定了一种姿态回归算法,称为GS-Refiner。通过利用李代数扩展3DGS,GS-Refiner获得了一个姿态可微的渲染管线,通过比较输入图像和渲染图像来细化粗略姿态。GS-Refiner还选择性地更新3DGS模型中的参数以实现环境适应,从而增强算法对光照变化、遮挡和其他具有挑战性的干扰因素的鲁棒性和灵活性。GS2Pose在LineMod数据集上进行了实验评估,并与类似算法进行了比较,取得了极具竞争力的结果。GS2Pose的代码将很快在GitHub上发布。

英文摘要:

This paper proposes a new method for accurate and robust 6D pose estimation of novel objects, named GS2Pose. By introducing 3D Gaussian splatting, GS2Pose can utilize the reconstruction results without requiring a high-quality CAD model, which means it only requires segmented RGBD images as input. Specifically, GS2Pose employs a two-stage structure consisting of coarse estimation followed by refined estimation. In the coarse stage, a lightweight U-Net network with a polarization attention mechanism, called Pose-Net, is designed. By using the 3DGS model for supervised training, Pose-Net can generate NOCS images to compute a coarse pose. In the refinement stage, GS2Pose formulates a pose regression algorithm following the idea of reprojection or Bundle Adjustment (BA), referred to as GS-Refiner. By leveraging Lie algebra to extend 3DGS, GS-Refiner obtains a pose-differentiable rendering pipeline that refines the coarse pose by comparing the input images with the rendered images. GS-Refiner also selectively updates parameters in the 3DGS model to achieve environmental adaptation, thereby enhancing the algorithm's robustness and flexibility to illuminative variation, occlusion, and other challenging disruptive factors. GS2Pose was evaluated through experiments conducted on the LineMod dataset, where it was compared with similar algorithms, yielding highly competitive results. The code for GS2Pose will soon be released on GitHub.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑