arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2007.00450cs.RO
收藏

反应行为反馈模型的监督学习和强化学习:触觉反馈实验床

Supervised Learning and Reinforcement Learning of Feedback Models for Reactive Behaviors: Tactile Feedback Testbed

Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);University of Southern California(南加利福尼亚大学);Intrinsic Innovation LLC.(Intrinsic创新有限责任公司);ETH Zurich(苏黎世联邦理工学院);Google Brain(谷歌大脑);Dexterity Inc.(Dexterity公司);Meta Artificial Intelligence(Meta人工智能)

Giovanni Sutanto, Katharina Rombach, Yevgen Chebotar, Zhe Su, Stefan Schaal, Gaurav S. Sukhatme, Franziska Meier

摘要:

机器人需要能够适应环境的意外变化,以便能够自主完成任务。然而,如果可能的话,手工设计适应的反馈模型是乏味的,这使得数据驱动的方法成为一种有前途的选择。在本文中,我们介绍了一个完整的框架,学习反馈模型的反应运动规划。我们的流水线首先通过半自动分割算法将完整任务的演示分割为运动基元。然后,给出成功的适应行为的额外示范,我们通过从示范中示教学习来学习初始反馈模型。在最后阶段,一个样本效率的强化学习算法通过很少的真实系统交互来微调这些反馈模型以适应新的任务设置。我们评估我们的方法在一个真正的拟人机器人学习触觉反馈任务。

英文摘要:

Robots need to be able to adapt to unexpected changes in the environment such that they can autonomously succeed in their tasks. However, hand-designing feedback models for adaptation is tedious, if at all possible, making data-driven methods a promising alternative. In this paper we introduce a full framework for learning feedback models for reactive motion planning. Our pipeline starts by segmenting demonstrations of a complete task into motion primitives via a semi-automated segmentation algorithm. Then, given additional demonstrations of successful adaptation behaviors, we learn initial feedback models through learning from demonstrations. In the final phase, a sample-efficient reinforcement learning algorithm fine-tunes these feedback models for novel task settings through few real system interactions. We evaluate our approach on a real anthropomorphic robot in learning a tactile feedback task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑