arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2610.20157cs.RO
收藏

Atomic-WAM:面向世界动作模型的执行基础原子运动推理

Atomic-WAM: Execution-Grounded Atomic-Motion Reasoning for World Action Models

ACE Robotics(ACE机器人公司);Zhejiang University(浙江大学);University of Hong Kong(香港大学);Jiangnan University(江南大学)

Shijun Shi, Zhe Liu, Zhi Hou, Yinan Chen, Tao Zhang, Kai Hu, Yong Liu, Jiangning Zhang

AI总结:

Atomic-WAM是连接任务推理与动作生成的“先理解再执行”框架,通过EG-GRPO后训练视觉语言推理器,在RoboLab现实到仿真评估中,默认指令下任务成功率达39.6%,模糊指令下达31.6%。

摘要:

世界动作模型(World Action Models, WAMs)通常通过联合视频与动作预测,将视频基础模型适配到机器人控制中。然而,任务级指令可能未明确指定下一次物理交互,需要语义接地和依赖状态的运动选择。为此,我们提出Atomic-WAM,这是一种“先理解再执行”的框架,通过原子运动描述将任务推理与动作生成关联起来。具体而言,视觉语言推理器从任务指令和视觉上下文描述下一个局部运动,引导WAM预测未来视频和动作块。此外,自动标注流水线从多视角DROID演示中整理时间对齐、接触丰富的监督信号。为使原子运动预测能被WAM执行,我们用执行基础的GRPO(Execution-Grounded GRPO, EG-GRPO)对推理器进行后训练。在固定WAM的情况下,EG-GRPO通过运动适当性和执行成功的奖励来适配推理器。最后,Atomic-WAM在RoboLab的现实到仿真评估中,在默认指令下实现39.6%的任务成功率,在模糊指令下实现31.6%的任务成功率。项目页面:this https URL

英文摘要:

World Action Models (WAMs) typically adapt video foundation models to robotic control through joint video and action prediction. However, task-level instructions may leave the next physical interaction underspecified, requiring semantic grounding and state-dependent motion selection. To this end, we introduce Atomic-WAM, an understand-then-execute framework that connects task reasoning to action generation through atomic-motion descriptions. Specifically, a vision-language reasoner describes the next local motion from the task instruction and visual context, guiding a WAM to predict future video and an action chunk. Furthermore, an automatic annotation pipeline curates temporally aligned, contact-enriched supervision from multi-view DROID demonstrations. To make atomic-motion predictions executable by the WAM, we post-train the reasoner with Execution-Grounded GRPO (EG-GRPO). With the WAM fixed, EG-GRPO adapts the reasoner through rewards for motion appropriateness and execution success. Finally, Atomic-WAM achieves 39.6% task success under default instructions and 31.6% under vague instructions in a real-to-sim evaluation on RoboLab. Project page: https://ssj9596.github.io/Atomic-WAM-project

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑