arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.15087cs.LO
收藏

作为分布变换器的马尔可夫链模型检测

Model Checking Markov Chains as Distribution Transformers

Rajab Aghamov, Christel Baier, Toghrul Karimov, Joris Nieuwveld, Joël Ouaknine, Jakob Piribauer, Mihir Vahanwala

AI总结:

针对传统马尔可夫链模型检测无法处理初始分布演化相关判定问题的局限,本文提出将马尔可夫链视为分布变换器的新视角,研究状态分布序列的时序属性检测问题,划定了随机矩阵驱动下该问题的可解实例类别。

摘要:

传统的马尔可夫链研究视角关注的是由状态访问轨迹满足时序属性的概率相关的判定问题。然而,请考虑针对一个天气建模随机系统提出的如下查询:给定今日的天气状况,是否会出现某一天降雨概率低于50%的情况?传统视角并不具备判定这类涉及初始分布演化问题的能力。我们所考虑的另一种视角将马尔可夫链视为分布变换器:研究重点是每一步的状态分布序列,其演化由底层的随机转移矩阵驱动。更确切地说,给定初始分布向量$μ$和随机更新转移矩阵$M$,我们探究由此产生的分布序列$(μ, Mμ, M^2μ, …)$是否满足给定时序属性。这是线性动力系统模型检测问题的一个特例,该问题在完全一般化的情况下是否可判定目前尚无定论。本文的目标是在动力学由随机矩阵支配的假设下,划定该问题可解的实例类别边界。

英文摘要:

The conventional perspective on Markov chains considers decision problems concerning the probabilities of temporal properties being satisfied by traces of visited states. However, consider the following query made of a stochastic system modelling the weather: given the conditions today, will there be a day with less than 50\% chance of rain? The conventional perspective is ill-equipped to decide such problems regarding the evolution of the initial distribution. The alternate perspective we consider views Markov chains as distribution transformers: the focus is on the sequence of distributions on states at each step, where the evolution is driven by the underlying stochastic transition matrix. More precisely, given an initial distribution vector $μ$, a stochastic update transition matrix $M$, we ask whether the ensuing sequence of distributions $(μ, Mμ, M^2μ, \dots)$ satisfies a given temporal property. This is a special case of the model-checking problem for linear dynamical systems, which is not known to be decidable in full generality. The goal of this article is to delineate the classes of instances for which this problem can be solved, under the assumption that the dynamics is governed by stochastic matrices.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑