arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.03077cs.RO
收藏

WorldPlanner:基于动作条件视觉世界模型的蒙特卡洛树搜索与MPC

WorldPlanner: Monte Carlo Tree Search and MPC with Action-Conditioned Visual World Models

Center for Robotics and Embodied Intelligence, Tandon School of Engineering, New York University, Brooklyn, NY(机器人与具身智能中心,工程学院,纽约大学,布鲁克林,纽约);FAIR at Meta(Meta的FAIR)

R. Khorrambakht, Joaquim Ortiz-Haro, Joseph Amigo, Omar Mostafa, Daniel Dugas, Franziska Meier, Ludovic Righetti

AI总结:

本文提出WorldPlanner,利用少量非结构化游玩数据学习动作条件视觉世界模型,并结合MCTS规划与零阶MPC执行,在真实机器人任务上显著优于行为克隆基线。

摘要:

机器人必须从原始感官输入中理解其环境,并推理其行为在环境中的后果,以解决复杂任务。行为克隆(BC)利用任务特定的人类演示,以端到端策略的形式学习这些知识。然而,这些策略难以迁移到新任务,并且生成训练数据具有挑战性,因为这需要精心设计的演示和频繁的环境重置。与这种基于策略的视角不同,本文采用基于模型的方法:我们收集几小时非结构化、易于采集的游玩数据,以学习一个动作条件视觉世界模型、一个基于扩散的动作采样器,以及可选地学习一个奖励模型。随后,该世界模型与动作采样器和奖励模型相结合,通过蒙特卡洛树搜索(MCTS)规划器来优化长动作序列。所得计划通过零阶模型预测控制器(MPC)在机器人上执行。我们表明,动作采样器能够缓解世界模型在规划过程中的幻觉问题,并在3个具有不同规划与建模复杂度的真实机器人任务上验证了我们的方法。我们的实验支持以下假设:在标准操作测试环境中,规划相比BC基线带来了显著改进。

英文摘要:

Robots must understand their environment from raw sensory inputs and reason about the consequences of their actions in it to solve complex tasks. Behavior Cloning (BC) leverages task-specific human demonstrations to learn this knowledge as end-to-end policies. However, these policies are difficult to transfer to new tasks, and generating training data is challenging because it requires careful demonstrations and frequent environment resets. In contrast to such policy-based view, in this paper we take a model-based approach where we collect a few hours of unstructured easy-to-collect play data to learn an action-conditioned visual world model, a diffusion-based action sampler, and optionally a reward model. The world model -- in combination with the action sampler and a reward model -- is then used to optimize long sequences of actions with a Monte Carlo Tree Search (MCTS) planner. The resulting plans are executed on the robot via a zeroth-order Model Predictive Controller (MPC). We show that the action sampler mitigates hallucinations of the world model during planning and validate our approach on 3 real-world robotic tasks with varying levels of planning and modeling complexity. Our experiments support the hypothesis that planning leads to a significant improvement over BC baselines on a standard manipulation test environment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑