arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.18852cs.RO

ForceWAM:从演示与游戏数据中解耦未来与响应学习以实现接触丰富型操作

ForceWAM: Decoupling Future and Response Learning from Demo and Play Data for Contact-Rich Manipulation

Fudan University(复旦大学);Shanghai Jiao Tong University(上海交通大学);Southeast University(东南大学);Shanghai Innovation Institute(上海创新研究院);Southern University of Science and Technology(南方科技大学);Noematrix Ltd.(诺伊矩阵有限公司)
Zijun Xu, Wendi Chen, Xinkai Wang, Jiachen Zou, Hongjin Chen, Hairuo Liu, Bokai Lin, Shihao Ma, Ke Ma, Zhiwei Zhang, Zhuohao Yan, Ke Wu, Haoming Song, Xueqi Li,… 展开作者

Zijun Xu, Wendi Chen, Xinkai Wang, Jiachen Zou, Hongjin Chen, Hairuo Liu, Bokai Lin, Shihao Ma, Ke Ma, Zhiwei Zhang, Zhuohao Yan, Ke Wu, Haoming Song, Xueqi Li, Chuan Wen, Jieru Zhao, Wenchao Ding, Cewu Lu, Lixin Yang

AI总结:

ForceWAM从演示与游戏数据解耦未来和响应学习,通过世界模型与逆动力学模型实现接触丰富型操作,在真实机器人任务中成功率达85%-95%,添加游戏数据可提升15-45个百分点。

摘要:

专家演示展示了如何完成接触丰富型任务,但对不同动作对应的交互力响应覆盖有限;任务无关的游戏数据则提供了更广泛的接触动力学经验,且不指定任务目标。为充分利用这两类数据,我们提出ForceWAM,即力世界动作模型,它将与任务兼容的交互结果知识,与局部动作如何改变接触的知识解耦。世界模型从成功的演示中学习,联合预测未来视频与六轴力/力矩轨迹,这些未来信息共同描述了任务过程中运动与接触的预期演化。单独的逆动力学模型(IDM)从任务数据与游戏数据中学习,将当前观测及记录的视觉- wrench(力旋量)未来信息映射至对应的机器人动作,因此游戏数据为目标导向的执行提供了力响应知识。部署时,IDM会将生成的未来信息反应式地转换为动作,并在世界模型更新间利用新的力旋量反馈重复使用这些动作。在真实机器人的力调控滑动、带/不带干扰的盒子翻转及环放置任务中,ForceWAM实现了85%-95%的平均成功率,优于世界建模及反应式基线方法。我们的实验进一步表明,添加任务无关的游戏数据可将成功率提升15-45个百分点,证明了其对学习接触丰富型执行的价值。项目页面与代码可在此https URL获取。

英文摘要:

Expert demonstrations show how to complete contact-rich tasks, but provide limited coverage of how interaction forces respond to different actions. Task-agnostic play provides broader experience of contact dynamics without specifying task goals. To fully leverage these two types of data, we introduce ForceWAM, a force world action model that decouples knowledge of task-compatible interaction outcomes from knowledge of how local actions change contact. A world model learns from successful demonstrations to jointly predict future video and six-axis force/torque trajectories. Together, these futures describe the expected evolution of motion and contact during the task. A separate inverse dynamics model (IDM) learns from both task and play, mapping current observations and recorded visual-wrench futures to their associated robot actions. Play data thus provide knowledge of force responses for goal-directed execution. At deployment, the IDM reactively translates generated futures into actions, reusing them with fresh wrench feedback between world-model updates. Across real-robot force-regulated sliding, box flipping with and without disturbances, and ring placement, ForceWAM achieves $85$-$95\%$ mean success, surpassing world-modeling and reactive baselines. Our experiments further show that adding task-agnostic play data improves success by $15$-$45$ percentage points, demonstrating its value for learning contact-rich execution. Project page and code are available at https://force-wam.github.io/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑