arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.07899cs.ROcs.AIcs.LG
收藏

通过无标记混合动作的自监督对抗模仿的多功能技能控制

Versatile Skill Control via Self-supervised Adversarial Imitation of Unlabeled Mixed Motions

Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);ETH Zurich(苏黎世联邦理工学院)

Chenhao Li, Sebastian Blaes, Pavel Kolev, Marin Vlastelica, Jonas Frey, Georg Martius

摘要:

学习不同的技能是机器人技术的主要挑战之一。为此,模仿学习方法已经取得了令人印象深刻的结果。这些方法需要明确标记的数据集或假设一致的技能执行,以实现对个体行为的学习和主动控制,这限制了它们的适用性。在这项工作中,我们提出了一种合作对抗方法,通过最大限度地提高其可辨别性,从包含不同状态转换模式的未标记数据集中获得具有可控技能集的单一通用策略。此外,我们表明,通过利用生成对抗模仿学习框架中的无监督技能发现,新的和有用的技能出现与成功的任务完成。最后,所获得的多功能的政策进行了测试,一个敏捷的四足机器人称为独奏8,并提出忠实的复制编码在演示中的各种技能。

英文摘要:

Learning diverse skills is one of the main challenges in robotics. To this end, imitation learning approaches have achieved impressive results. These methods require explicitly labeled datasets or assume consistent skill execution to enable learning and active control of individual behaviors, which limits their applicability. In this work, we propose a cooperative adversarial method for obtaining single versatile policies with controllable skill sets from unlabeled datasets containing diverse state transition patterns by maximizing their discriminability. Moreover, we show that by utilizing unsupervised skill discovery in the generative adversarial imitation learning framework, novel and useful skills emerge with successful task fulfillment. Finally, the obtained versatile policies are tested on an agile quadruped robot called Solo 8 and present faithful replications of diverse skills encoded in the demonstrations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑