arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.05941cs.ROcs.CVcs.LG
收藏

在仿真中评估真实世界机器人操作策略

Evaluating Real-World Robot Manipulation Policies in Simulation

UC San Diego(加利福尼亚大学圣地亚哥分校);Stanford University(斯坦福大学);UC Berkeley(加利福尼亚大学伯克利分校);Google Deepmind(谷歌DeepMind)
Xuanlin Li, Kyle Hsu, Jiayuan Gu, Karl Pertsch, Oier Mees, Homer Rich Walke, Chuyuan Fu, Ishikaa Lunawat, Isabel Sieh, Sean Kirmani, Sergey Levine, Jiajun Wu, C… 展开作者

Xuanlin Li, Kyle Hsu, Jiayuan Gu, Karl Pertsch, Oier Mees, Homer Rich Walke, Chuyuan Fu, Ishikaa Lunawat, Isabel Sieh, Sean Kirmani, Sergey Levine, Jiajun Wu, Chelsea Finn, Hao Su, Quan Vuong, Ted Xiao

AI总结:

该研究针对真实机器人操作策略评估难扩展、难复现的问题,提出缩小仿真与真实间控制及视觉差异的方法,并构建 SIMPLER 仿真环境集合,实现与真实表现高度相关的策略评估。

摘要:

机器人学领域在迈向通用机器人操作策略方面已取得重大进展。然而,对此类策略进行真实世界评估不具备可扩展性,并且面临可复现性挑战;随着策略所能执行任务的范围不断扩大,这些问题可能会进一步恶化。我们将真实环境与仿真环境之间的控制差异和视觉差异确定为可靠仿真评估的关键挑战,并提出了一些方法来缩小这些差距,而无需构建真实环境的全保真数字孪生。随后,我们利用这些方法创建了 SIMPLER,这是一组用于在常见真实机器人配置上评估操作策略的仿真环境集合。通过对操作策略进行成对的仿真与真实评估,我们证明了策略在 SIMPLER 环境中的表现与其在真实世界中的表现之间存在强相关性。此外,我们发现 SIMPLER 评估能够准确反映真实世界中的策略行为模式,例如对各种分布偏移的敏感性。我们将所有 SIMPLER 环境以及用于创建新环境的工作流程在 https://simpler-env.github.io 上开源,以促进通用操作策略和仿真评估框架的研究。

英文摘要:

The field of robotics has made significant advances towards generalist robot manipulation policies. However, real-world evaluation of such policies is not scalable and faces reproducibility challenges, which are likely to worsen as policies broaden the spectrum of tasks they can perform. We identify control and visual disparities between real and simulated environments as key challenges for reliable simulated evaluation and propose approaches for mitigating these gaps without needing to craft full-fidelity digital twins of real-world environments. We then employ these approaches to create SIMPLER, a collection of simulated environments for manipulation policy evaluation on common real robot setups. Through paired sim-and-real evaluations of manipulation policies, we demonstrate strong correlation between policy performance in SIMPLER environments and in the real world. Additionally, we find that SIMPLER evaluations accurately reflect real-world policy behavior modes such as sensitivity to various distribution shifts. We open-source all SIMPLER environments along with our workflow for creating new environments at https://simpler-env.github.io to facilitate research on general-purpose manipulation policies and simulated evaluation frameworks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑