arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0903.2445cs.LO
收藏

概率系统的定性逻辑与等价性

Qualitative Logics and Equivalences for Probabilistic Systems

Krishnendu Chatterjee, Luca de Alfaro, Marco Faella, Axel Legay

摘要:

我们调查的逻辑和等价关系,捕捉定性行为的马尔可夫决策过程(MDP)。我们提出了定性随机CTL(QRCTL):这种逻辑公式可以表达这样一个事实,即某些时间属性持有所有路径,或概率为0或1,但它们不区分中间概率值。我们提出了一个符号的,多项式时间模型检测算法的QRCTL MDP。逻辑QRCTL在MDP的状态上导出了一个等价关系,我们称之为定性等价:非正式地说,如果两个状态下概率为0或1的公式集相同,则两个状态是定性等价的。我们表明,对于有限的交替MDP,其中不确定性和概率的选择发生在不同的状态,定性等价与交替互模拟相吻合,因此可以通过有效的分区细化算法计算。另一方面,在非交替MDP中,等价关系不能通过划分细化算法来计算,而是需要非局部计算。最后,我们考虑QRCTL*,它以与CTL* 扩展CTL相同的方式用嵌套的时态运算符扩展QRCTL。我们表明,QRCTL和QRCTL* 诱导交替MDP相同的定性等价,而在非交替MDP,从QRCTL* 产生的等价可以严格更精细。我们还提供了一个完整的定性等价,互模拟,交替互模拟之间的关系的表征,根据是否MDP是有限的,以及他们的过渡关系是否是有限分支。

英文摘要:

We investigate logics and equivalence relations that capture the qualitative behavior of Markov Decision Processes (MDPs). We present Qualitative Randomized CTL (QRCTL): formulas of this logic can express the fact that certain temporal properties hold over all paths, or with probability 0 or 1, but they do not distinguish among intermediate probability values. We present a symbolic, polynomial time model-checking algorithm for QRCTL on MDPs. The logic QRCTL induces an equivalence relation over states of an MDP that we call qualitative equivalence: informally, two states are qualitatively equivalent if the sets of formulas that hold with probability 0 or 1 at the two states are the same. We show that for finite alternating MDPs, where nondeterministic and probabilistic choices occur in different states, qualitative equivalence coincides with alternating bisimulation, and can thus be computed via efficient partition-refinement algorithms. On the other hand, in non-alternating MDPs the equivalence relations cannot be computed via partition-refinement algorithms, but rather, they require non-local computation. Finally, we consider QRCTL*, that extends QRCTL with nested temporal operators in the same manner in which CTL* extends CTL. We show that QRCTL and QRCTL* induce the same qualitative equivalence on alternating MDPs, while on non-alternating MDPs, the equivalence arising from QRCTL* can be strictly finer. We also provide a full characterization of the relation between qualitative equivalence, bisimulation, and alternating bisimulation, according to whether the MDPs are finite, and to whether their transition relations are finitely-branching.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑