arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1810.04877cs.HCcs.AIcs.RO
收藏

通过使用策略性内在动机学习者的运动策略序列来学习一组相互关联的任务

Learning a Set of Interrelated Tasks by Using Sequences of Motor Policies for a Strategic Intrinsically Motivated Learner

Université Bretagne Sud(南布列塔尼大学);IMT Atlantique(大西洋高等矿业电信学校)

Nicolas Duminy, Sao Mai Nguyen, Dominique Duhaut

摘要:

我们提出了一个主动学习架构的机器人,能够组织其学习过程,以实现一个领域的复杂任务,通过学习序列的电机政策,称为内部激励程序咿呀学语(IM-PB)。学习者可以概括其经验,不断学习新的任务。它根据自身进步的经验衡量,积极选择学习什么和如何学习。在本文中,我们正在考虑学习的一组相互关联的任务成果层次组织。我们引入了一个框架,称为“程序”,这是由以前学到的技能的组合定义的政策序列。我们的算法架构使用这些程序来自主发现如何结合简单的技能来实现复杂的目标。它在两种目标导向的探索策略之间进行积极的选择:探索政策空间或程序空间。我们在一个模拟的环境中表明,我们的新架构能够处理复杂的运动策略的学习,以适应其政策的复杂性,手头的任务。我们还表明,我们的“程序”框架有助于学习者解决困难的层次任务。

英文摘要:

We propose an active learning architecture for robots, capable of organizing its learning process to achieve a field of complex tasks by learning sequences of motor policies, called Intrinsically Motivated Procedure Babbling (IM-PB). The learner can generalize over its experience to continuously learn new tasks. It chooses actively what and how to learn based by empirical measures of its own progress. In this paper, we are considering the learning of a set of interrelated tasks outcomes hierarchically organized. We introduce a framework called 'procedures', which are sequences of policies defined by the combination of previously learned skills. Our algorithmic architecture uses the procedures to autonomously discover how to combine simple skills to achieve complex goals. It actively chooses between 2 strategies of goal-directed exploration : exploration of the policy space or the procedural space. We show on a simulated environment that our new architecture is capable of tackling the learning of complex motor policies, to adapt the complexity of its policies to the task at hand. We also show that our 'procedures' framework helps the learner to tackle difficult hierarchical tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑