arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1209.2883eess.SYcs.SYmath.OC
收藏

安全约束下马尔可夫链的控制设计:一种凸方法

Control Design for Markov Chains under Safety Constraints: A Convex Approach

University of Maryland, College Park(马里兰大学帕克分校)

Eduardo Arvelo, Nuno C. Martins

AI总结:

针对有限状态空间完全观测受控马尔可夫链,提出一种基于熵最大化原理的有限参数凸规划方法,设计时不变无记忆控制策略,最大化闭环系统中安全递归状态集。

摘要:

本文关注具有有限状态空间的完全观测受控马尔可夫链的时不变无记忆控制策略设计。通过预先选定的禁止状态集施加安全约束。如果一个状态不是禁止状态,且其转移到禁止状态的概率为零,则该状态被认定为安全状态。主要目标是获得控制策略,使得闭环系统生成最大的安全递归状态集,其中可能包含多个递归类。提出了一种基于熵最大化原理的有限参数凸规划设计方法。给出了数值示例,并讨论了附加约束的采用。

英文摘要:

This paper focuses on the design of time-invariant memoryless control policies for fully observed controlled Markov chains, with a finite state space. Safety constraints are imposed through a pre-selected set of forbidden states. A state is qualified as safe if it is not a forbidden state and the probability of it transitioning to a forbidden state is zero. The main objective is to obtain control policies whose closed loop generates the maximal set of safe recurrent states, which may include multiple recurrent classes. A design method is proposed that relies on a finitely parametrized convex program inspired on entropy maximization principles. A numerical example is provided and the adoption of additional constraints is discussed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑