两个DRAGGN的故事:解释面向对象和面向目标指令的混合方法
A Tale of Two DRAGGNs: A Hybrid Approach for Interpreting Action-Oriented and Goal-Oriented Instructions
摘要:
在各种随机环境中与人类一起工作的机器人必须能够准确地解释自然语言命令。这些指令通常分为两类:指定目标条件或目标状态的指令,以及指定显式操作或如何执行给定任务的指令。最近的方法已经使用奖励函数作为基于目标的命令的语义表示,其允许使用最先进的规划器来为给定任务找到策略。然而,这些奖励函数不能直接用于表示面向动作的命令。我们引入了一种新的混合方法,深度递归目标接地网络(DRAGGN),用于任务接地和执行,处理来自任何类别的自然语言作为输入,并推广到看不见的环境。我们的机器人仿真结果表明,一个系统成功地解释目标导向和行动导向的任务规范,使我们更接近强大的自然语言理解人机交互。
英文摘要:
Robots operating alongside humans in diverse, stochastic environments must be able to accurately interpret natural language commands. These instructions often fall into one of two categories: those that specify a goal condition or target state, and those that specify explicit actions, or how to perform a given task. Recent approaches have used reward functions as a semantic representation of goal-based commands, which allows for the use of a state-of-the-art planner to find a policy for the given task. However, these reward functions cannot be directly used to represent action-oriented commands. We introduce a new hybrid approach, the Deep Recurrent Action-Goal Grounding Network (DRAGGN), for task grounding and execution that handles natural language from either category as input, and generalizes to unseen environments. Our robot-simulation results demonstrate that a system successfully interpreting both goal-oriented and action-oriented task specifications brings us closer to robust natural language understanding for human-robot interaction.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。