arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.00631cs.ROcs.AIcs.LGcs.SYeess.SY
收藏

基于残差模型学习的微机器人控制

Residual Model Learning for Microrobot Control

Massachusetts Institute of Technology(麻省理工学院)

Joshua Gruenstein, Tao Chen, Neel Doshi, Pulkit Agrawal

摘要:

大多数微型机器人都是使用难以分析建模的顺从材料构造的,从而限制了传统基于模型的控制器的实用性。微型机器人数据汇集的挑战以及仿真模型与真实机器人之间的大误差使得当前基于模型的学习和仿真到现实迁移方法难以应用。我们提出了一种新的框架残差模型学习(RML),利用近似模型,大大降低了与学习准确的机器人模型相关的样本复杂性。我们表明,使用RML,我们可以学习一个模型的哈佛流动微型机器人(HAMR)仅使用12秒的被动收集的交互数据。学习的模型足够精确,可以用作“代理模拟器”,用于使用无模型强化学习算法学习行走和转弯行为。RML提供了一个通用的框架,从极少量的交互数据进行学习,我们的实验HAMR清楚地表明,RML大大优于现有的技术。

英文摘要:

A majority of microrobots are constructed using compliant materials that are difficult to model analytically, limiting the utility of traditional model-based controllers. Challenges in data collection on microrobots and large errors between simulated models and real robots make current model-based learning and sim-to-real transfer methods difficult to apply. We propose a novel framework residual model learning (RML) that leverages approximate models to substantially reduce the sample complexity associated with learning an accurate robot model. We show that using RML, we can learn a model of the Harvard Ambulatory MicroRobot (HAMR) using just 12 seconds of passively collected interaction data. The learned model is accurate enough to be leveraged as "proxy-simulator" for learning walking and turning behaviors using model-free reinforcement learning algorithms. RML provides a general framework for learning from extremely small amounts of interaction data, and our experiments with HAMR clearly demonstrate that RML substantially outperforms existing techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑