arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.06838cs.RO
收藏

基于逆强化学习的力相关任务变阻抗控制

Learning Variable Impedance Control via Inverse Reinforcement Learning for Force-Related Tasks

University of California, Berkeley(加州大学伯克利分校);Harbin Institute of Technology(哈尔滨工业大学)

Xiang Zhang, Liting Sun, Zhian Kuang, Masayoshi Tomizuka

摘要:

许多操作任务需要机器人与未知环境进行交互。在此类应用中,根据不同任务阶段和环境约束调整阻抗的能力对于安全性和性能至关重要。虽然已经提出了许多基于深度强化学习(RL)和从演示示教学习(LfD)学习的方法来获得接触丰富的操作任务上的可变阻抗技能,但是这些技能通常是特定于任务的,并且可能对任务设置的变化敏感。本文提出了一种基于逆强化学习(IRL)的方法,从专家演示中恢复可变阻抗策略和奖励函数。我们探索不同的行动空间的奖励函数,以实现更一般的表示专家的可变阻抗技能。两个可变阻抗任务(钉孔和杯板)的实验进行了模拟和真正的FANUC LR Mate 200 iD/7 L工业机器人。与行为克隆和基于力的IRL的比较结果表明,增益动作空间中的学习奖励函数比力空间中的学习奖励函数具有更好的可传递性。实验视频可在https://msc.berkeley.edu/research/impedance-irl.html上获得。

英文摘要:

Many manipulation tasks require robots to interact with unknown environments. In such applications, the ability to adapt the impedance according to different task phases and environment constraints is crucial for safety and performance. Although many approaches based on deep reinforcement learning (RL) and learning from demonstration (LfD) have been proposed to obtain variable impedance skills on contact-rich manipulation tasks, these skills are typically task-specific and could be sensitive to changes in task settings. This paper proposes an inverse reinforcement learning (IRL) based approach to recover both the variable impedance policy and reward function from expert demonstrations. We explore different action space of the reward functions to achieve a more general representation of expert variable impedance skills. Experiments on two variable impedance tasks (Peg-in-Hole and Cup-on-Plate) were conducted in both simulations and on a real FANUC LR Mate 200iD/7L industrial robot. The comparison results with behavior cloning and force-based IRL proved that the learned reward function in the gain action space has better transferability than in the force space. Experiment videos are available at https://msc.berkeley.edu/research/impedance-irl.html.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑