arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1401.3439cs.AI
收藏

通过基于信任的自主性进行交互式策略学习

Interactive Policy Learning through Confidence-Based Autonomy

Carnegie Mellon University(卡内基梅隆大学)

Sonia Chernova, Manuela Veloso

摘要:

我们提出了基于信任的自主性(CBA),一个互动的策略学习从示范算法。CBA算法由两个组件组成,利用人类和计算机代理的互补能力。第一个组件Confident Execution使智能体能够识别需要演示的状态,请求人类教师进行演示,并根据获取的数据学习策略。该算法选择的动作选择信心的措施的基础上的示范,我们的研究结果表明,使用信心执行的代理需要更少的示范学习的政策比当示范由人类教师选择。第二个算法组件,纠正演示,使教师能够纠正任何错误的代理通过额外的演示,以提高政策和未来的任务性能。CBA和它的各个组成部分进行了比较和评估,在一个复杂的模拟驾驶域。完整的CBA算法导致最佳的整体学习性能,成功地再现了教师的行为,同时平衡了学习过程中演示次数和错误动作次数之间的权衡。

英文摘要:

We present Confidence-Based Autonomy (CBA), an interactive algorithm for policy learning from demonstration. The CBA algorithm consists of two components which take advantage of the complimentary abilities of humans and computer agents. The first component, Confident Execution, enables the agent to identify states in which demonstration is required, to request a demonstration from the human teacher and to learn a policy based on the acquired data. The algorithm selects demonstrations based on a measure of action selection confidence, and our results show that using Confident Execution the agent requires fewer demonstrations to learn the policy than when demonstrations are selected by a human teacher. The second algorithmic component, Corrective Demonstration, enables the teacher to correct any mistakes made by the agent through additional demonstrations in order to improve the policy and future task performance. CBA and its individual components are compared and evaluated in a complex simulated driving domain. The complete CBA algorithm results in the best overall learning performance, successfully reproducing the behavior of the teacher while balancing the tradeoff between number of demonstrations and number of incorrect actions during learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑