arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.07728cs.CVcs.GRcs.RO

GEAR: 基于高斯点划法的几何-运动交替优化用于关节物体建模

GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splatting

Key Laboratory of AI Safety of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS(中国科学院人工智能安全重点实验室,中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学)

Jialin Li, Bin Fu, Ruiping Wang, Xilin Chen

AI总结:

GEAR通过交替优化几何与运动,提升关节物体重建的精度和泛化能力,尤其在复杂多关节物体上表现优异。

摘要:

高保真交互数字资产对具身智能和机器人交互至关重要,但关节物体因复杂结构和耦合的几何-运动关系仍难以重建。现有方法在几何-运动联合优化中不稳定,且在复杂多关节或分布外物体上泛化能力有限。为此,我们提出GEAR,一种EM风格的交替优化框架,将几何和运动作为相互依赖的组件联合建模于高斯点划法表示中。GEAR将部分分割视为潜在变量,将关节运动参数作为显式变量,交替优化以提高收敛性和几何-运动一致性。为提升部分分割质量而不牺牲泛化能力,我们利用普通的2D分割模型提供多视图部分先验,并采用弱监督约束来正则化潜在变量。在多个基准和新构建的GEAR-Multi数据集上实验表明,GEAR在几何重建和运动参数估计上取得了最先进的结果,尤其在具有多个可移动部分的复杂关节物体上表现突出。

英文摘要:

High-fidelity interactive digital assets are essential for embodied intelligence and robotic interaction, yet articulated objects remain challenging to reconstruct due to their complex structures and coupled geometry-motion relationships. Existing methods suffer from instability in geometry-motion joint optimization, while their generalization remains limited on complex multi-joint or out-of-distribution objects. To address these challenges, we propose GEAR, an EM-style alternating optimization framework that jointly models geometry and motion as interdependent components within a Gaussian Splatting representation. GEAR treats part segmentation as a latent variable and joint motion parameters as explicit variables, alternately refining them for improved convergence and geometric-motion consistency. To enhance part segmentation quality without sacrificing generalization, we leverage a vanilla 2D segmentation model to provide multi-view part priors, and employ a weakly supervised constraint to regularize the latent variable. Experiments on multiple benchmarks and our newly constructed dataset GEAR-Multi demonstrate that GEAR achieves state-of-the-art results in geometric reconstruction and motion parameters estimation, particularly on complex articulated objects with multiple movable parts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑