马尔可夫过程的理性疏忽控制
Rationally inattentive control of Markov processes
摘要:
本文提出了一个一般模型的最优控制受信息约束,部分动机是最近的工作,西姆斯和其他人的信息约束决策的经济代理。在平均成本最优控制框架中,本文介绍的一般模型减少到平均成本最优控制问题的线性规划表示的一个变体,受到随机平稳策略上的附加互信息约束。由此产生的最优化问题是凸的,并承认基于Bellman误差的分解,这是近似动态规划的研究对象。通过信息约束的线性二次高斯(LQG)控制问题的例子来说明该理论。本文还给出了关于无限时域贴现成本准则的一些结果。
英文摘要:
The article poses a general model for optimal control subject to information constraints, motivated in part by recent work of Sims and others on information-constrained decision-making by economic agents. In the average-cost optimal control framework, the general model introduced in this paper reduces to a variant of the linear-programming representation of the average-cost optimal control problem, subject to an additional mutual information constraint on the randomized stationary policy. The resulting optimization problem is convex and admits a decomposition based on the Bellman error, which is the object of study in approximate dynamic programming. The theory is illustrated through the example of information-constrained linear-quadratic-Gaussian (LQG) control problem. Some results on the infinite-horizon discounted-cost criterion are also presented.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。