arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2306.11706cs.ROcs.LG
收藏

RoboCat:一种用于机器人操作的自改进通用智能体

RoboCat: A Self-Improving Generalist Agent for Robotic Manipulation

Google DeepMind(谷歌DeepMind)
Konstantinos Bousmalis, Giulia Vezzani, Dushyant Rao, Coline Devin, Alex X. Lee, Maria Bauza, Todor Davchev, Yuxiang Zhou, Agrim Gupta, Akhil Raju, Antoine Laur… 展开作者

Konstantinos Bousmalis, Giulia Vezzani, Dushyant Rao, Coline Devin, Alex X. Lee, Maria Bauza, Todor Davchev, Yuxiang Zhou, Agrim Gupta, Akhil Raju, Antoine Laurens, Claudio Fantacci, Valentin Dalibard, Martina Zambelli, Murilo Martins, Rugile Pevceviciute, Michiel Blokzijl, Misha Denil, Nathan Batchelor, Thomas Lampe, Emilio Parisotto, Konrad Żołna, Scott Reed, Sergio Gómez Colmenarejo, Jon Scholz, Abbas Abdolmaleki, Oliver Groth, Jean-Baptiste Regli, Oleg Sushkov, Tom Rothörl, José Enrique Chen, Yusuf Aytar, Dave Barker, Joy Ortiz, Martin Riedmiller, Jost Tobias Springenberg, Raia Hadsell, Francesco Nori, Nicolas Heess

AI总结:

RoboCat是一种多本体、多任务的视觉目标条件化决策变换器,利用异构机器人经验实现零样本及少量示例适应新任务,并通过自生成数据支持自主改进循环,在模拟和真实机器人上验证了跨任务迁移与高效适应能力。

摘要:

利用来自不同机器人和任务的异构机器人经验,以快速掌握新技能和本体,这一能力有潜力彻底改变机器人学习。受近期视觉和语言基础模型进展的启发,我们提出了一种多本体、多任务的通用智能体,用于机器人操作。该智能体名为RoboCat,是一个视觉目标条件化的决策变换器,能够消费带有动作标签的视觉经验。这些数据涵盖了来自模拟和真实机器人手臂的广泛运动控制技能,具有不同的观测和动作设置。通过RoboCat,我们展示了其对新任务和机器人的泛化能力,既包括零样本泛化,也包括仅使用目标任务的100-1000个示例进行适应后的泛化。我们还展示了如何利用训练后的模型自身生成数据,用于后续的训练迭代,从而为自主改进循环提供了基本构建模块。我们通过大规模评估,在模拟环境和三种不同的真实机器人本体上,研究了该智能体的能力。我们发现,随着训练数据的增长和多样化,RoboCat不仅表现出跨任务迁移的迹象,而且在适应新任务方面也变得更加高效。

英文摘要:

The ability to leverage heterogeneous robotic experience from different robots and tasks to quickly master novel skills and embodiments has the potential to transform robot learning. Inspired by recent advances in foundation models for vision and language, we propose a multi-embodiment, multi-task generalist agent for robotic manipulation. This agent, named RoboCat, is a visual goal-conditioned decision transformer capable of consuming action-labelled visual experience. This data spans a large repertoire of motor control skills from simulated and real robotic arms with varying sets of observations and actions. With RoboCat, we demonstrate the ability to generalise to new tasks and robots, both zero-shot as well as through adaptation using only 100-1000 examples for the target task. We also show how a trained model itself can be used to generate data for subsequent training iterations, thus providing a basic building block for an autonomous improvement loop. We investigate the agent's capabilities, with large-scale evaluations both in simulation and on three different real robot embodiments. We find that as we grow and diversify its training data, RoboCat not only shows signs of cross-task transfer, but also becomes more efficient at adapting to new tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑