arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.04003cs.LGstat.ML
收藏

动物群体运动的贝叶斯逆强化学习

Bayesian Inverse Reinforcement Learning for Collective Animal Movement

University of Missouri(密苏里大学);U. S. Geological Survey(美国地质调查局);Colorado State University(科罗拉多州立大学)

Toryn L. J. Schafer, Christopher K. Wikle, Mevin B. Hooten

摘要:

基于代理的方法允许定义生成复杂群体行为的简单规则。这种模型的管理规则通常是先验设置的,并且参数是根据观察到的行为轨迹来调整的。反向强化学习不是对所有预期场景进行简化假设,而是通过使用马尔可夫决策过程的属性来提供对管理长期行为策略的短期(局部)规则的推断。我们使用计算效率的线性可解马尔可夫决策过程学习的本地规则集体运动的模拟的自推进粒子(SPP)模型和数据应用程序的捕获孔雀鱼人口。行为决策成本的估计是在贝叶斯框架与基函数平滑。我们在SPP模拟中恢复了真实的成本,发现孔雀鱼更重视集体运动而不是有针对性的运动。

英文摘要:

Agent-based methods allow for defining simple rules that generate complex group behaviors. The governing rules of such models are typically set a priori and parameters are tuned from observed behavior trajectories. Instead of making simplifying assumptions across all anticipated scenarios, inverse reinforcement learning provides inference on the short-term (local) rules governing long term behavior policies by using properties of a Markov decision process. We use the computationally efficient linearly-solvable Markov decision process to learn the local rules governing collective movement for a simulation of the self propelled-particle (SPP) model and a data application for a captive guppy population. The estimation of the behavioral decision costs is done in a Bayesian framework with basis function smoothing. We recover the true costs in the SPP simulation and find the guppies value collective movement more than targeted movement toward shelter.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑