arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.09770cs.AI
收藏

基于记忆引导的模仿学习任务适应

Language-guided Task Adaptation for Imitation Learning

University of Texas at Austin(德克萨斯大学奥斯汀分校);University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校)

Prasoon Goyal, Raymond J. Mooney, Scott Niekum

摘要:

我们引入了一种新的设置,其中代理需要学习一个任务,从演示的相关任务之间的差异,在自然语言沟通。建议的设置允许重用其他任务的演示,通过提供低工作量的语言描述,也可以用来提供反馈,以纠正代理错误,这都是重要的必要条件,为建设智能代理,协助人类的日常任务。为了在这个建议的设置中取得进展,我们创建了两个基准-房间重新安排和房间导航-涵盖了一组不同的任务适应。此外,我们提出了一个框架,使用基于转换器的模型来推理任务中的实体及其关系,以学习目标任务的策略

英文摘要:

We introduce a novel setting, wherein an agent needs to learn a task from a demonstration of a related task with the difference between the tasks communicated in natural language. The proposed setting allows reusing demonstrations from other tasks, by providing low effort language descriptions, and can also be used to provide feedback to correct agent errors, which are both important desiderata for building intelligent agents that assist humans in daily tasks. To enable progress in this proposed setting, we create two benchmarks -- Room Rearrangement and Room Navigation -- that cover a diverse set of task adaptations. Further, we propose a framework that uses a transformer-based model to reason about the entities in the tasks and their relationships, to learn a policy for the target task

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑