arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1610.09409cs.AIcs.RO
收藏

复杂认知任务的概率模型检验--以人机交互为例

Probabilistic Model Checking for Complex Cognitive Tasks -- A case study in human-robot interaction

RWTH Aachen University(亚琛工业大学);The University of Texas at Austin(德克萨斯大学奥斯汀分校)

Sebastian Junges, Nils Jansen, Joost-Pieter Katoen, Ufuk Topcu

摘要:

本文提出了使用概率模型检验来合成最优机器人策略的多任务自主系统,受到人机交互。鉴于令人信服的经验证据表明,人类行为可以与强化模型,我们作为输入的一个良好的研究Q表模型的灵活的情况下,人类行为。我们首先描述了一个自动化的过程中提取马尔可夫决策过程(MDP)的人在任意但固定的情况。与众不同的问题是,与现有的模型相比,其中包括对人类行为的规范不足。概率模型检验用于预测人的行为。最后,MDP模型扩展与机器人模型。最优的机器人策略合成分析所产生的两个玩家的随机游戏。使用PRISM的原型实现的实验结果显示出良好的效果。

英文摘要:

This paper proposes to use probabilistic model checking to synthesize optimal robot policies in multi-tasking autonomous systems that are subject to human-robot interaction. Given the convincing empirical evidence that human behavior can be related to reinforcement models, we take as input a well-studied Q-table model of the human behavior for flexible scenarios. We first describe an automated procedure to distill a Markov decision process (MDP) for the human in an arbitrary but fixed scenario. The distinctive issue is that -- in contrast to existing models -- under-specification of the human behavior is included. Probabilistic model checking is used to predict the human's behavior. Finally, the MDP model is extended with a robot model. Optimal robot policies are synthesized by analyzing the resulting two-player stochastic game. Experimental results with a prototypical implementation using PRISM show promising results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑