arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.11019cs.RO
收藏

Refinery:面向富接触策略的主动微调与部署时优化

Refinery: Active Fine-tuning and Deployment-time Optimization for Contact-Rich Policies

Bingjie Tang, Iretiayo Akinola, Jie Xu, Bowen Wen, Dieter Fox, Gaurav S. Sukhatme, Fabio Ramos, Abhishek Gupta, Yashraj Narang

AI总结:

本文提出Refinery框架,通过贝叶斯优化引导的微调和高斯混合模型采样,提升富接触任务策略在多变初始条件下的鲁棒性,使机器人装配成功率显著提高并支持长时序多部件串联。

摘要:

基于模拟的学习使得用于精确、富接触任务(例如机器人装配)的策略在高水平观测噪声和控制误差下达到了高成功率(~80%)。尽管这样的性能对于研究应用可能足够,但它未达到工业标准,并使得策略串联异常脆弱。一个关键限制是在不同初始条件下单个策略性能的高方差。我们引入了Refinery,这是一个有效的框架,能够弥合这一性能差距,增强策略在不同初始条件下的性能。我们提出基于贝叶斯优化的微调来改进单个策略,并在部署期间使用基于高斯混合模型的采样来选择最大化执行成功的初始化。使用Refinery,我们在机器人装配的基于模拟的学习中,将平均成功率比最先进的方法提高了10.98%,在模拟中达到91.51%,并在现实世界中达到可比的性能。此外,我们证明了这些微调后的策略可以串联以完成长时序、多部件装配——成功组装多达8个部件,而无需显式的多步训练。

英文摘要:

Simulation-based learning has enabled policies for precise, contact-rich tasks (e.g., robotic assembly) to reach high success rates (~80%) under high levels of observation noise and control error. Although such performance may be sufficient for research applications, it falls short of industry standards and makes policy chaining exceptionally brittle. A key limitation is the high variance in individual policy performance across diverse initial conditions. We introduce Refinery, an effective framework that bridges this performance gap, robustifying policy performance across initial conditions. We propose Bayesian Optimization-guided fine-tuning to improve individual policies, and Gaussian Mixture Model-based sampling during deployment to select initializations that maximize execution success. Using Refinery, we improve mean success rates by 10.98% over state-of-the-art methods in simulation-based learning for robotic assembly, reaching 91.51% in simulation and comparable performance in the real world. Furthermore, we demonstrate that these fine-tuned policies can be chained to accomplish long-horizon, multi-part assembly$\unicode{x2013}$successfully assembling up to 8 parts without requiring explicit multi-step training.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑