arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.11291cs.RO
收藏

H-WM:由分层世界模型引导的机器人任务和运动规划

H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model

Huawei Noah’s Ark Lab(华为诺亚实验室);University of Toronto(多伦多大学);University of British Columbia(不列颠哥伦比亚大学);McGill University(麦吉尔大学)

Jinbang Huang, Wenyuan Chen, Zhiyuan Li, Oscar Pang, Xiao Hu, Lingfeng Zhang, Yuanzhao Hu, Mark Coates, Tongtong Cao, Xingyue Quan, Zhanguang Zhang, Yingxue Zhang

AI总结:

H-WM通过结合逻辑和视觉世界模型,实现机器人任务和运动规划中的鲁棒长视界推理与稳定引导。

摘要:

世界模型正成为机器人规划和控制的核心,因为它们能够预测未来状态转换。现有方法往往强调视频生成或自然语言预测,这些在机器人动作中难以定位,并且在长时间范围内会累积误差。经典的任务和运动规划模型在逻辑空间中预测世界转换,使机器人能够执行并具有鲁棒的长视界推理。然而,它们通常与视觉感知独立运作,防止了符号和视觉状态预测的同步。我们提出了一种分层世界模型(H-WM),在统一框架内联合预测逻辑和视觉状态转换。H-WM结合了高级逻辑世界模型和低级视觉世界模型,将符号推理的长视界鲁棒性与视觉定位相结合。分层输出为长视界任务提供稳定的中间引导,缓解误差积累,并在扩展的任务序列中实现鲁棒执行。在多个视觉-语言-动作(VLA)控制策略上的实验展示了H-WM指导的有效性和通用性。

英文摘要:

World models are becoming central to robotic planning and control by predicting future state transitions. Existing approaches mainly rely on visual, latent, or language prediction, which can be difficult to ground in executable robot actions and prone to compounding errors over long horizons. In contrast, traditional robotic task and motion planning enables structured long-horizon reasoning through compact symbolic representations of world transitions, but typically lacks synchronized visual prediction. We propose Hierarchical World Model (H-WM), which jointly predicts logical and visual state transitions by combining a high-level logical world model with a low-level visual world model. The predicted logical actions and latent visual state transitions are jointly incorporated into Vision-Language-Action (VLA) models as intermediate state guidance for long-horizon task execution. Experiments on three long-horizon benchmarks and real robots show that H-WM consistently improves VLA's performance by stabilizing long-horizon execution and mitigating error accumulation. We also construct LIBERO-Logic, a frame-level aligned dataset that pairs visual observations and continuous robot states with logical actions and predicate-based logical states.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑