arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.23253cs.RO
收藏

SPARR: 基于模拟的策略与不对称现实残差的装配

SPARR: Simulation-based Policies with Asymmetric Real-world Residuals for Assembly

Nvidia;University of Washington(华盛顿大学)

Yijie Guo, Iretiayo Akinola, Lars Johannsmeier, Hugo Hadfield, Abhishek Gupta, Yashraj Narang

AI总结:

SPARR通过结合模拟训练的基础策略和现实残差策略,有效解决现实世界装配任务中的性能下降问题,提升成功率并减少循环时间。

摘要:

机器人装配由于其对精确且接触丰富的操控要求,长期以来一直是一个挑战。虽然基于模拟的学习已经使开发鲁棒的装配策略成为可能,但当部署到现实世界中时,其性能往往因仿真到现实的差距而下降。相反,现实世界强化学习(RL)方法避免了仿真到现实的差距,但严重依赖于人类监督,并且缺乏对环境变化的泛化能力。在本工作中,我们提出了一种混合方法,结合了在模拟中训练的基础策略和现实世界残差策略,以高效适应现实世界的差异。基础策略在模拟中使用低级状态观测和密集奖励进行训练,为初始行为提供强先验。残差策略在现实世界中使用视觉观测和稀疏奖励进行学习,补偿动力学和传感器噪声的差异。广泛的现实世界实验表明,我们的方法SPARR在多样化的两部分装配任务中实现了接近完美的成功率。与最先进的零样本仿真到现实方法相比,SPARR将成功率提高了38.4%,同时将循环时间减少了29.7%。此外,SPARR不需要人类专业知识,与最先进的现实世界RL方法相比,后者严重依赖于人类监督。

英文摘要:

Robotic assembly presents a long-standing challenge due to its requirement for precise, contact-rich manipulation. While simulation-based learning has enabled the development of robust assembly policies, their performance often degrades when deployed in real-world settings due to the sim-to-real gap. Conversely, real-world reinforcement learning (RL) methods avoid the sim-to-real gap, but rely heavily on human supervision and lack generalization ability to environmental changes. In this work, we propose a hybrid approach that combines a simulation-trained base policy with a real-world residual policy to efficiently adapt to real-world variations. The base policy, trained in simulation using low-level state observations and dense rewards, provides strong priors for initial behavior. The residual policy, learned in the real world using visual observations and sparse rewards, compensates for discrepancies in dynamics and sensor noise. Extensive real-world experiments demonstrate that our method, SPARR, achieves near-perfect success rates across diverse two-part assembly tasks. Compared to the state-of-the-art zero-shot sim-to-real methods, SPARR improves success rates by 38.4% while reducing cycle time by 29.7%. Moreover, SPARR requires no human expertise, in contrast to the state-of-the-art real-world RL approaches that depend heavily on human supervision.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑