arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.26786cs.CVcs.GRcs.LG
收藏

HEIR:学习基于图的运动层次结构

HEIR: Learning Graph-Based Motion Hierarchies

Princeton University(普林斯顿大学);Torc Robotics(Torc机器人公司)

Cheng Zheng, William Koch, Baiang Li, Felix Heide

AI总结:

提出一种通用的层次化运动建模方法,通过可微图学习将全局运动分解为父级继承模式与局部残差,在1D、2D及动态3D场景形变中展现出更真实且可解释的重建效果。

摘要:

运动层次结构存在于计算机视觉、图形学和机器人学等多个研究领域中,其中复杂的动力学通常源于简单运动组件之间的协调交互。现有用于建模此类动力学的方法通常依赖于手动定义或启发式的层次结构以及固定的运动基元,这限制了它们在不同任务间的泛化能力。在本研究中,我们提出了一种通用的层次化运动建模方法,能够直接从数据中学习结构化且可解释的运动关系。该方法使用基于图的层次结构来表示观测到的运动,明确地将全局绝对运动分解为父级继承模式和局部运动残差。我们将层次结构推断表述为一个可微的图学习问题,其中顶点表示基本运动,有向边通过图神经网络捕获学习到的父子依赖关系。我们在三个示例上评估了我们的层次重建方法:1D平移运动、2D旋转运动以及通过Gaussian splatting实现的动态3D场景形变。实验结果表明,我们的方法在1D和2D情况下重建了内在的运动层次结构,并在动态3D Gaussian splatting场景中与基线相比产生了更真实且可解释的形变。通过提供一种自适应的、数据驱动的层次化建模范式,我们的方法为广泛的以运动为中心的任务提供了一种适用的公式化表达。项目页面:https://light.princeton.edu/HEIR/

英文摘要:

Hierarchical structures of motion exist across research fields, including computer vision, graphics, and robotics, where complex dynamics typically arise from coordinated interactions among simpler motion components. Existing methods to model such dynamics typically rely on manually-defined or heuristic hierarchies with fixed motion primitives, limiting their generalizability across different tasks. In this work, we propose a general hierarchical motion modeling method that learns structured, interpretable motion relationships directly from data. Our method represents observed motions using graph-based hierarchies, explicitly decomposing global absolute motions into parent-inherited patterns and local motion residuals. We formulate hierarchy inference as a differentiable graph learning problem, where vertices represent elemental motions and directed edges capture learned parent-child dependencies through graph neural networks. We evaluate our hierarchical reconstruction approach on three examples: 1D translational motion, 2D rotational motion, and dynamic 3D scene deformation via Gaussian splatting. Experimental results show that our method reconstructs the intrinsic motion hierarchy in 1D and 2D cases, and produces more realistic and interpretable deformations compared to the baseline on dynamic 3D Gaussian splatting scenes. By providing an adaptable, data-driven hierarchical modeling paradigm, our method offers a formulation applicable to a broad range of motion-centric tasks. Project Page: https://light.princeton.edu/HEIR/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑