arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2403.10683cs.CV

GS-Pose:基于3D高斯溅射的可泛化分割式6D物体姿态估计

GS-Pose: Generalizable Segmentation-based 6D Object Pose Estimation with 3D Gaussian Splatting

Tampere University(坦佩雷大学);University of Oulu(奥卢大学)

Dingding Cai, Janne Heikkilä, Esa Rahtu

AI总结:

本文提出GS-Pose统一框架,通过分阶段采用不同物体表示,结合3D高斯溅射优化6D物体姿态估计,在两个数据集上达到当前最优性能,支持用普通设备采集新物体。

摘要:

本文提出GS-Pose,一种用于定位并估计新物体6D姿态的统一框架。GS-Pose首先获取一组已知姿态的、针对未见过物体的RGB图像,构建三种不同的表示并存入数据库。推理时,GS-Pose按顺序运行:在输入图像中定位物体,用检索方法估计初始6D姿态,再用渲染对比方法优化姿态。核心思路是在流程各阶段使用合适的物体表示。尤其在优化步骤,我们利用3D Gaussian splatting(3D高斯溅射),这是一种新型可微渲染技术,渲染速度快且优化时间相对较短。现成工具链和消费级硬件(如手机)可用于捕获待加入数据库的新物体。在LINEMOD和OnePose-LowTexture数据集上的大量评估表明其性能优异,创下了新的state-of-the-art(当前最优水平)。项目页面:https://dingdingcai.github.io/gs-pose。

英文摘要:

This paper introduces GS-Pose, a unified framework for localizing and estimating the 6D pose of novel objects. GS-Pose begins with a set of posed RGB images of a previously unseen object and builds three distinct representations stored in a database. At inference, GS-Pose operates sequentially by locating the object in the input image, estimating its initial 6D pose using a retrieval approach, and refining the pose with a render-and-compare method. The key insight is the application of the appropriate object representation at each stage of the process. In particular, for the refinement step, we leverage 3D Gaussian splatting, a novel differentiable rendering technique that offers high rendering speed and relatively low optimization time. Off-the-shelf toolchains and commodity hardware, such as mobile phones, can be used to capture new objects to be added to the database. Extensive evaluations on the LINEMOD and OnePose-LowTexture datasets demonstrate excellent performance, establishing the new state-of-the-art. Project page: https://dingdingcai.github.io/gs-pose.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑