arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1903.01267cs.AIcs.LG
收藏

使用因果分析从任务演示中学习规范

Using Causal Analysis to Learn Specifications from Task Demonstrations

University of Edinburgh(爱丁堡大学)

Daniel Angelov, Yordan Hristov, Subramanian Ramamoorthy

摘要:

用户行为的学习模型是一个重要的问题,广泛适用于许多需要人机交互的应用领域。在这项工作中,我们表明,它是可以学习的生成模型不同的用户行为类型,从人类的演示中提取,通过执行聚类的首选任务的解决方案内的潜在空间。我们使用这个模型来区分用户类型,并找到具有重叠解决方案的案例。此外,我们可以通过学习的可微模型反向传播来改变最初猜测的解决方案,以满足构成特定用户类型的偏好。以这种方式构建生成模型的一个优点是,它允许我们提取符号之间的因果关系,这些符号可能构成用户对任务的规范的一部分,正如演示中所表现的那样。我们表明,所提出的方法是能够正确区分三种用户类型,谁在他们的运动中的谨慎程度不同,而执行的任务与动觉驱动的机器人在桌面环境中移动物体。我们的方法在99% [97.8 - 99.8]的情况下在指定时间内成功识别出正确的类型,这优于IRL基线。我们还表明,我们提出的方法正确地改变了一个默认的轨迹,以满足特定的用户规范,即使是看不见的对象。所得到的轨迹示出的是直接实施的PR 2人形机器人完成相同的任务。

英文摘要:

Learning models of user behaviour is an important problem that is broadly applicable across many application domains requiring human-robot interaction. In this work we show that it is possible to learn a generative model for distinct user behavioral types, extracted from human demonstrations, by enforcing clustering of preferred task solutions within the latent space. We use this model to differentiate between user types and to find cases with overlapping solutions. Moreover, we can alter an initially guessed solution to satisfy the preferences that constitute a particular user type by backpropagating through the learned differentiable model. An advantage of structuring generative models in this way is that it allows us to extract causal relationships between symbols that might form part of the user's specification of the task, as manifested in the demonstrations. We show that the proposed method is capable of correctly distinguishing between three user types, who differ in degrees of cautiousness in their motion, while performing the task of moving objects with a kinesthetically driven robot in a tabletop environment. Our method successfully identifies the correct type, within the specified time, in 99% [97.8 - 99.8] of the cases, which outperforms an IRL baseline. We also show that our proposed method correctly changes a default trajectory to one satisfying a particular user specification even with unseen objects. The resulting trajectory is shown to be directly implementable on a PR2 humanoid robot completing the same task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑