arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1905.04427cs.RO
收藏

变柔度机器人装配快速技能学习

Fast Skill Learning for Variable Compliance Robotic Assembly

Tsinghua University(清华大学)

Tianyu Ren, Yunfei Dong, Dan Wu, Ken Chen

摘要:

机器人装配代表了一组强化学习和可变顺应性控制的基准问题,其特征在于复杂的接触操作。将强化学习应用于物理机器人的关键挑战之一是样本的复杂性,即学习需要大量的经验。我们通过将迭代改装的模型纳入学习过程中,通过模型引导的探索来缓解这个样本复杂性问题。然而,拟合物理环境的局部模型是主要困难。在这项工作中,一个卡尔曼滤波器被用来结合自适应线性动态与一个粗略的先验模型从解析描述,并证明了给更准确的预测比现有的方法。实验结果表明,所提出的模型拟合策略可以应用于模型预测控制器中,在保持无模型强化学习优点的同时,为学习加速提供良好的探索行为.除了样本的复杂性之外,机器人在操作过程中不可避免的过载也往往会限制学习效率。为了解决这个问题,我们提出了一种方法,以限制最大可能的势能在顺应性控制系统,从而保持接触力在合理的范围内。

英文摘要:

The robotic assembly represents a group of benchmark problems for reinforcement learning and variable compliance control that features sophisticated contact manipulation. One of the key challenges in applying reinforcement learning to physical robot is the sample complexity, the requirement of large amounts of experience for learning. We mitigate this sample complexity problem by incorporating an iteratively refitted model into the learning process through model-guided exploration. Yet, fitting a local model of the physical environment is of major difficulties. In this work, a Kalman filter is used to combine the adaptive linear dynamics with a coarse prior model from analytical description, and proves to give more accurate predictions than the existing method. Experimental results show that the proposed model fitting strategy can be incorporated into a model predictive controller to generate good exploration behaviors for learning acceleration, while preserving the benefits of model-free reinforcement learning for uncertain environments. In addition to the sample complexity, the inevitable robot overloaded during operation also tends to limit the learning efficiency. To address this problem, we present a method to restrict the largest possible potential energy in the compliance control system and therefore keep the contact force within the legitimate range.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑