arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.12759math.OCcs.SYeess.SY
收藏

分布在希尔伯特空间嵌入的随机最优控制

Stochastic Optimal Control via Hilbert Space Embeddings of Distributions

Adam J. Thorpe, Meeko M. K. Oishi

摘要:

分布的核嵌入最近在机器学习社区中作为用于表示概率分布的数据驱动技术获得了极大的关注。广义地说,这些技术通过将积分算子表示为再生核希尔伯特空间中的元素来实现期望的有效计算。我们将这些技术应用到随机最优控制理论领域,并提出了一种计算具有任意扰动的随机系统的近似最优策略的方法。我们的方法减少了最优化问题的线性规划,可以很容易地解决通过拉格朗日对偶,而不诉诸于基于梯度的优化算法。我们专注于离散时间动态规划,并证明我们提出的方法上的线性调节问题,和非线性目标跟踪问题。这种方法广泛适用于各种各样的最优控制问题,并提供了一种在数据驱动的环境中处理随机系统的方法。

英文摘要:

Kernel embeddings of distributions have recently gained significant attention in the machine learning community as a data-driven technique for representing probability distributions. Broadly, these techniques enable efficient computation of expectations by representing integral operators as elements in a reproducing kernel Hilbert space. We apply these techniques to the area of stochastic optimal control theory and present a method to compute approximately optimal policies for stochastic systems with arbitrary disturbances. Our approach reduces the optimization problem to a linear program, which can easily be solved via the Lagrangian dual, without resorting to gradient-based optimization algorithms. We focus on discrete-time dynamic programming, and demonstrate our proposed approach on a linear regulation problem, and on a nonlinear target tracking problem. This approach is broadly applicable to a wide variety of optimal control problems, and provides a means of working with stochastic systems in a data-driven setting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑