arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.12501eess.SYcs.CRcs.GTcs.LOcs.SY
收藏

满足LTL规范的部分可观测环境中的安全控制

Secure Control in Partially Observable Environments to Satisfy LTL Specifications

Bhaskar Ramasubramanian, Luyao Niu, Andrew Clark, Linda Bushnell, Radha Poovendran

摘要:

本文研究了在部分可观察环境中,在对手存在的情况下,必须满足时序逻辑规范的智能体的控制策略的合成。代理(防御者)与对手的相互作用被建模为部分可观察的随机博弈。我们的目标是生成一个防御者的政策,以最大限度地满足给定的时间逻辑规范下的任何对手的政策。搜索策略仅限于有限状态控制器的空间,这导致了一个易于处理的方法来确定策略。我们的规范达到(子集)经常性状态的马尔可夫链的满意度。我们提出了一个算法来确定一组防守者和对手的有限状态控制器的固定大小,将满足时序逻辑规范,并证明它是健全的。然后,我们提出了一个值迭代算法,以最大限度地满足时间逻辑规范下的有限状态控制器的固定大小的概率。最后,我们将此设置扩展到防御者的有限状态控制器的大小可以增加以提高满意度概率的情况。我们用一个例子来说明我们的方法。

英文摘要:

This paper studies the synthesis of control policies for an agent that has to satisfy a temporal logic specification in a partially observable environment, in the presence of an adversary. The interaction of the agent (defender) with the adversary is modeled as a partially observable stochastic game. The goal is to generate a defender policy to maximize satisfaction of a given temporal logic specification under any adversary policy. The search for policies is limited to the space of finite state controllers, which leads to a tractable approach to determine policies. We relate the satisfaction of the specification to reaching (a subset of) recurrent states of a Markov chain. We present an algorithm to determine a set of defender and adversary finite state controllers of fixed sizes that will satisfy the temporal logic specification, and prove that it is sound. We then propose a value-iteration algorithm to maximize the probability of satisfying the temporal logic specification under finite state controllers of fixed sizes. Lastly, we extend this setting to the scenario where the size of the finite state controller of the defender can be increased to improve the satisfaction probability. We illustrate our approach with an example.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑