TuneNet:用于系统辨识和机器人任务转换的一次性残差调整
TuneNet: One-Shot Residual Tuning for System Identification and Sim-to-Real Robot Task Transfer
摘要:
随着研究人员教机器人执行越来越复杂的任务,对逼真的仿真环境的需求也在增长。通过近似真实世界物理来缩小现实差距的现有技术通常需要大量的真实世界数据和/或数千个模拟样本。本文介绍了TuneNet,这是一种基于机器学习的新方法,可以使用 * 迭代残差调整 * 技术直接调整一个模型的参数以匹配另一个模型。TuneNet使用来自目标的单个观测和最小模拟来估计两个模型之间的参数差异,从而实现快速、准确和样本效率高的参数估计。该系统可以通过监督学习在自动生成的模拟数据集上进行训练。我们表明,TuneNet可以执行系统辨识,即使当真正的参数值位于训练过程中看到的分布之外,并证明与TuneNet调整的模拟器优于现有的预测刚体运动的技术。最后,我们证明了我们的方法可以估计真实世界的参数值,允许机器人在训练过程中看不到的动态操作任务上执行模拟到真实的任务转移。代码和视频可在http://bit.ly/2lf1bAw上在线获得。
英文摘要:
As researchers teach robots to perform more and more complex tasks, the need for realistic simulation environments is growing. Existing techniques for closing the reality gap by approximating real-world physics often require extensive real world data and/or thousands of simulation samples. This paper presents TuneNet, a new machine learning-based method to directly tune the parameters of one model to match another using an *iterative residual tuning* technique. TuneNet estimates the parameter difference between two models using a single observation from the target and minimal simulation, allowing rapid, accurate and sample-efficient parameter estimation. The system can be trained via supervised learning over an auto-generated simulated dataset. We show that TuneNet can perform system identification, even when the true parameter values lie well outside the distribution seen during training, and demonstrate that simulators tuned with TuneNet outperform existing techniques for predicting rigid body motion. Finally, we show that our method can estimate real-world parameter values, allowing a robot to perform sim-to-real task transfer on a dynamic manipulation task unseen during training. Code and videos are available online at http://bit.ly/2lf1bAw.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。