arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1607.01478cs.ROcs.AIcs.SYeess.SY
收藏

混合策略用于受约束的随机最优控制

Mixed Strategy for Constrained Stochastic Optimal Control

University of Washington(华盛顿大学);Stanford University(斯坦福大学)

Masahiro Ono, Mahmoud El Chamie, Marco Pavone, Behcet Acikmese

AI总结:

本文提出混合策略用于受约束的随机最优控制,证明随机化控制输入在非凸优化问题中可降低成本,等于对偶间隙,并提出基于对偶优化的高效求解方法。

摘要:

在具有随机约束的最优控制问题中,随机选择控制输入可以降低预期成本,例如随机模型预测控制(SMPC)。我们考虑具有初始随机化的控制器,即在开始时随机选择K+1个控制序列(称为K-随机化)。已知对于具有K个约束的有限状态、有限动作马尔可夫决策过程(MDP),K-随机化足以达到最小成本。我们发现,对于具有连续状态和动作空间的随机最优控制问题,相同结果也成立。进一步,我们证明当优化问题非凸时,控制输入的随机化可以导致成本降低,且该降低量等于对偶间隙。然后,我们提供随机解最优性的必要和充分条件,并开发基于对偶优化的高效求解方法。此外,在K=1的特殊情况(如联合概率约束问题)中,对偶优化可通过根查找更高效地解决。最后,我们在路径规划到未来火星任务的着陆、下降和着陆(EDL)规划等多个实际问题上测试理论并演示求解方法。

英文摘要:

Choosing control inputs randomly can result in a reduced expected cost in optimal control problems with stochastic constraints, such as stochastic model predictive control (SMPC). We consider a controller with initial randomization, meaning that the controller randomly chooses from K+1 control sequences at the beginning (called K-randimization).It is known that, for a finite-state, finite-action Markov Decision Process (MDP) with K constraints, K-randimization is sufficient to achieve the minimum cost. We found that the same result holds for stochastic optimal control problems with continuous state and action spaces.Furthermore, we show the randomization of control input can result in reduced cost when the optimization problem is nonconvex, and the cost reduction is equal to the duality gap. We then provide the necessary and sufficient conditions for the optimality of a randomized solution, and develop an efficient solution method based on dual optimization. Furthermore, in a special case with K=1 such as a joint chance-constrained problem, the dual optimization can be solved even more efficiently by root finding. Finally, we test the theories and demonstrate the solution method on multiple practical problems ranging from path planning to the planning of entry, descent, and landing (EDL) for future Mars missions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑