arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1611.01767econ.GNmath.OCq-fin.ECstat.ML
收藏

EM算法与经济学中的随机控制

EM Algorithm and Stochastic Control in Economics

National University of Singapore(新加坡国立大学);Hong Kong University of Science and Technology(香港科技大学);Columbia University(哥伦比亚大学)

Steven Kou, Xianhua Peng, Xingbo Xu

AI总结:

本文提出EM-Control算法用于解决多期随机控制问题,通过正向反向蒙特卡洛模拟更新策略,具备单调收敛性,应用于 perishable assets 垄断定价与 real business cycle 研究。

摘要:

在经典EM算法广泛用于计算最大似然估计的基础上,本文提出EM-Control (EM-C)算法用于求解多期有限时间 horizon 的随机控制问题。该算法在每个时间周期内通过正向-反向方向的蒙特卡洛模拟依次更新控制策略;换句话说,算法在每个迭代中正向模拟并反向优化。与EM算法类似,EM-C算法在每次迭代中具有性能改进的单调性,从而具有良好的收敛性质。通过求解 perishable assets 的垄断定价和 real business cycle 研究中的随机控制问题,展示了该算法的有效性。

英文摘要:

Generalising the idea of the classical EM algorithm that is widely used for computing maximum likelihood estimates, we propose an EM-Control (EM-C) algorithm for solving multi-period finite time horizon stochastic control problems. The new algorithm sequentially updates the control policies in each time period using Monte Carlo simulation in a forward-backward manner; in other words, the algorithm goes forward in simulation and backward in optimization in each iteration. Similar to the EM algorithm, the EM-C algorithm has the monotonicity of performance improvement in each iteration, leading to good convergence properties. We demonstrate the effectiveness of the algorithm by solving stochastic control problems in the monopoly pricing of perishable assets and in the study of real business cycle.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑