arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1207.4167cs.AIcs.LG
收藏

预测状态表示:动态系统建模的新理论

Predictive State Representations: A New Theory for Modeling Dynamical Systems

University of Michigan(密歇根大学)

Satinder Singh, Michael James, Matthew Rudary

摘要:

建模动态系统,无论是为了控制的目的,并对他们的行为作出预测,是无处不在的科学和工程。预测状态表示(PSR)是最近引入的一类离散时间动态系统的模型。PSR和密切相关的OOM(Jaeger的可观测算子模型)背后的关键思想是将系统的状态表示为一组可观测实验结果的预测。这使得PSR与基于历史的模型(如n阶马尔可夫模型)和基于隐藏状态的模型(如Hacks和POMDP)有很大的不同。我们引入了一个有趣的结构,系统动力学矩阵,并展示了如何可以简单地从它导出PSR。我们还使用这个结构正式表明,PSR是更一般的比n阶马尔可夫模型和HALF/POMDPs。最后,我们讨论了PSR和OOM之间的主要区别,并总结了未来工作的方向。

英文摘要:

Modeling dynamical systems, both for control purposes and to make predictions about their behavior, is ubiquitous in science and engineering. Predictive state representations (PSRs) are a recently introduced class of models for discrete-time dynamical systems. The key idea behind PSRs and the closely related OOMs (Jaeger's observable operator models) is to represent the state of the system as a set of predictions of observable outcomes of experiments one can do in the system. This makes PSRs rather different from history-based models such as nth-order Markov models and hidden-state-based models such as HMMs and POMDPs. We introduce an interesting construct, the systemdynamics matrix, and show how PSRs can be derived simply from it. We also use this construct to show formally that PSRs are more general than both nth-order Markov models and HMMs/POMDPs. Finally, we discuss the main difference between PSRs and OOMs and conclude with directions for future work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑