arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2007.10281cs.LGcs.AIstat.ML
收藏

通过简单技能模仿学习获得复杂技能

Complex Skill Acquisition Through Simple Skill Imitation Learning

University of California, Berkeley(加州大学伯克利分校);Department of Electrical Engineering and Computer Sciences(电气工程与计算机科学系)

Pranay Pasula

摘要:

人类通常将复杂任务视为简单子任务的组合,以便更有效地学习这些复杂任务。例如,一个后空翻可以被认为是四个子技能的组合:跳跃,屈膝,向后滚动和向下插入手臂。基于这一推理思路,我们提出了一种新的算法,该算法在简单、易学的技能上训练神经网络策略,以培养潜在空间,加速复杂、难学技能的模仿学习。我们专注于复杂的任务包括一个并发的(可能是顺序的)简单的子任务的组合的情况下,因此我们的算法可以被看作是一种新的方法,并发分层模仿学习。我们评估了我们的算法在高维环境中的困难任务,发现它在训练速度和整体性能方面始终优于最先进的基线。

英文摘要:

Humans often think of complex tasks as combinations of simpler subtasks in order to learn those complex tasks more efficiently. For example, a backflip could be considered a combination of four subskills: jumping, tucking knees, rolling backwards, and thrusting arms downwards. Motivated by this line of reasoning, we propose a new algorithm that trains neural network policies on simple, easy-to-learn skills in order to cultivate latent spaces that accelerate imitation learning of complex, hard-to-learn skills. We focus on the case in which the complex task comprises a concurrent (and possibly sequential) combination of the simpler subtasks, and therefore our algorithm can be seen as a novel approach to concurrent hierarchical imitation learning. We evaluate our algorithm on difficult tasks in a high-dimensional environment and find that it consistently outperforms a state-of-the-art baseline in training speed and overall performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑