arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.03340cs.CVcs.AI
收藏

学习可加性组合的潜在动作以实现具身AI

Learning Additively Compositional Latent Actions for Embodied AI

Wuhan University(武汉大学);Tsinghua University(清华大学);Microsoft Research(微软研究院)

Hangxing Wei, Xiaoyu Chen, Chuheng Zhang, Tim Pearce, Jianyu Chen, Alex Lamb, Li Zhao, Jiang Bian

AI总结:

本文提出AC-LAM模型,通过强制潜在动作空间上的可加性组合结构,提升动作表示的结构性和准确性,优于现有方法。

摘要:

潜在动作学习通过从视觉转换推断伪动作标签,为具身AI利用互联网级视频提供了一种方法。然而,大多数方法在学习潜在动作时缺乏编码物理运动加性、组合结构的先验结构。结果,潜在动作往往将无关场景细节或未来观察信息与真实状态变化混合,并错误校准运动幅度。我们引入可加性组合潜在动作模型(AC-LAM),在潜在动作空间上强制短时间范围内的场景加性组合结构。这些AC约束鼓励潜在动作空间中的简单代数结构(身份、逆、循环一致性)并抑制无法加性组合的信息。实验表明,AC-LAM学习了更具结构、运动特定性和位移校准的潜在动作,并为下游策略学习提供了更强的监督,优于现有最先进LAMs在模拟和现实桌面上的任务中。

英文摘要:

Latent action learning infers pseudo-action labels from visual transitions, providing an approach to leverage internet-scale video for embodied AI. However, most methods learn latent actions without structural priors that encode the additive, compositional structure of physical motion. As a result, latents often entangle irrelevant scene details or information about future observations with true state changes and miscalibrate motion magnitude. We introduce Additively Compositional Latent Action Model (AC-LAM), which enforces scene-wise additive composition structure over short horizons on the latent action space. These AC constraints encourage simple algebraic structure in the latent action space~(identity, inverse, cycle consistency) and suppress information that does not compose additively. Empirically, AC-LAM learns more structured, motion-specific, and displacement-calibrated latent actions and provides stronger supervision for downstream policy learning, outperforming state-of-the-art LAMs across simulated and real-world tabletop tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑