arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1301.3630cs.LG
收藏

一种新的行为模式识别表示模型

Behavior Pattern Recognition using A New Representation Model

University of Virginia(弗吉尼亚大学)

Qifeng Qiao, Peter A. Beling

摘要:

我们研究了使用逆强化学习(IRL)作为工具,用于识别代理的行为的基础上观察他们的顺序决策行为与环境的相互作用。我们建模的代理所面临的问题作为一个马尔可夫决策过程(MDP)和模型的代理的前瞻性规划方面的观察到的行为。我们使用IRL来学习奖励函数,然后使用这些奖励函数作为聚类或分类模型的基础。实验研究与GridWorld,导航问题,秘书问题,最佳停止问题,建议奖励向量IRL发现行为模式识别问题的一个很好的基础。我们的方法与几个现有的IRL算法和直接的方法,使用在状态-动作空间中观察到的特征统计的实证比较表明,它可能是优于识别问题。

英文摘要:

We study the use of inverse reinforcement learning (IRL) as a tool for the recognition of agents' behavior on the basis of observation of their sequential decision behavior interacting with the environment. We model the problem faced by the agents as a Markov decision process (MDP) and model the observed behavior of the agents in terms of forward planning for the MDP. We use IRL to learn reward functions and then use these reward functions as the basis for clustering or classification models. Experimental studies with GridWorld, a navigation problem, and the secretary problem, an optimal stopping problem, suggest reward vectors found from IRL can be a good basis for behavior pattern recognition problems. Empirical comparisons of our method with several existing IRL algorithms and with direct methods that use feature statistics observed in state-action space suggest it may be superior for recognition problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑