arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1907.07500cs.ROcs.AIcs.LG
收藏

接触敏感任务的学习变阻抗控制

Learning Variable Impedance Control for Contact Sensitive Tasks

Max-Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);New York University(纽约大学)

Miroslav Bogdanovic, Majid Khadiv, Ludovic Righetti

摘要:

强化学习算法在解决从玩视频游戏到机器人等不同问题方面取得了巨大成功。然而,他们很难解决微妙的机器人问题,特别是那些涉及接触互动的问题。虽然原则上直接输出关节力矩的策略应该能够学习执行这些任务,但在实践中,我们看到,在动作空间中没有任何给定结构的情况下,很难鲁棒地解决问题。在本文中,我们研究了如何选择的行动空间可以给鲁棒性能存在接触的不确定性。我们提出了一种学习策略,给出输出阻抗和期望的位置在关节空间,并比较不同的接触不确定性下的转矩和位置控制的方法的性能。此外,我们提出了一个额外的奖励条款,旨在规范这些可变阻抗控制政策,使他们的可解释性,并促进其转移到真实的系统。我们提出了广泛的实验模拟浮动和固定基地系统的任务,涉及接触的不确定性,以及在一个真实的系统上运行的学习政策的结果。

英文摘要:

Reinforcement learning algorithms have shown great success in solving different problems ranging from playing video games to robotics. However, they struggle to solve delicate robotic problems, especially those involving contact interactions. Though in principle a policy directly outputting joint torques should be able to learn to perform these tasks, in practice we see that it has difficulty to robustly solve the problem without any given structure in the action space. In this paper, we investigate how the choice of action space can give robust performance in presence of contact uncertainties. We propose learning a policy giving as output impedance and desired position in joint space and compare the performance of that approach to torque and position control under different contact uncertainties. Furthermore, we propose an additional reward term designed to regularize these variable impedance control policies, giving them interpretability and facilitating their transfer to real systems. We present extensive experiments in simulation of both floating and fixed-base systems in tasks involving contact uncertainties, as well as results for running the learned policies on a real system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑