arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2107.02349cs.ROcs.LGcs.SYeess.SY
收藏

作为沟通的物理交互:从人类校正在线学习机器人目标

Physical Interaction as Communication: Learning Robot Objectives Online from Human Corrections

University of California, Berkeley(加州大学伯克利分校)

Dylan P. Losey, Andrea Bajcsy, Marcia K. O'Malley, Anca D. Dragan

摘要:

当机器人在人类旁边执行任务时,物理交互是不可避免的:人类可能会推,拉,扭曲或引导机器人。最先进的技术将这些相互作用视为机器人应该拒绝或避免的干扰。最好的情况是,这些机器人在人类互动时安全地做出反应;但在人类放手后,这些机器人只是恢复到原来的行为。我们认识到,物理人机交互(pHRI)通常是故意的-人类故意干预,因为机器人没有正确地完成任务。在本文中,我们认为,当pHRI是故意的,它也是信息:机器人可以利用互动来学习它应该如何完成其当前任务的其余部分,即使在人放手。我们将pHRI形式化为一个动态系统,其中人类心中有一个他们希望机器人优化的目标函数,但机器人无法直接存取该目标的参数-它们是人类内部的。在我们提出的框架内,人类的互动成为对真正目标的观察。我们引入近似来实时学习和响应pHRI。我们认识到,并非所有的人类校正都是完美的:用户经常与机器人进行嘈杂的交互,因此我们通过减少无意的学习来提高pHRI的机器人学习效率。最后,我们进行模拟和用户研究的机器人机械手比较我们提出的方法的国家的最先进的。我们的研究结果表明,从pHRI学习导致更好的任务性能和提高人类的满意度。

英文摘要:

When a robot performs a task next to a human, physical interaction is inevitable: the human might push, pull, twist, or guide the robot. The state-of-the-art treats these interactions as disturbances that the robot should reject or avoid. At best, these robots respond safely while the human interacts; but after the human lets go, these robots simply return to their original behavior. We recognize that physical human-robot interaction (pHRI) is often intentional -- the human intervenes on purpose because the robot is not doing the task correctly. In this paper, we argue that when pHRI is intentional it is also informative: the robot can leverage interactions to learn how it should complete the rest of its current task even after the person lets go. We formalize pHRI as a dynamical system, where the human has in mind an objective function they want the robot to optimize, but the robot does not get direct access to the parameters of this objective -- they are internal to the human. Within our proposed framework human interactions become observations about the true objective. We introduce approximations to learn from and respond to pHRI in real-time. We recognize that not all human corrections are perfect: often users interact with the robot noisily, and so we improve the efficiency of robot learning from pHRI by reducing unintended learning. Finally, we conduct simulations and user studies on a robotic manipulator to compare our proposed approach to the state-of-the-art. Our results indicate that learning from pHRI leads to better task performance and improved human satisfaction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑