arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.08588cs.LGcs.FL
收藏

连续时间马尔可夫链参数估计的MM算法

MM Algorithms to Estimate Parameters in Continuous-time Markov Chains

Aalborg University(奥尔堡大学);Reykjavík University(雷克雅未克大学)

Giovanni Bacci, Anna Ingólfsdóttir, Kim G. Larsen, Raphaël Reynouard

摘要:

连续时间马尔可夫链(CTMCs)是一种流行的建模形式,它构成了实时概率系统(如排队网络、随机过程代数和系统生物学演算)的底层语义。Prism和Storm是流行的模型检验工具,它们为CTMC提供了许多强大的分析技术。这些工具接受的模型表示为并行组合的一些模块相互作用。分析的结果在很大程度上取决于模型中使用的参数值,这些参数值决定了所产生的CTMC事件的时间和概率。然而,对于某些应用程序,参数值必须根据部分可观察的执行经验估计。在这项工作中,我们解决的问题,估计参数值的CTMCs表示为棱镜模型从一些部分可观察的执行。我们引入类参数CTMCs- CTMCs的转换率是多项式函数的一组参数-作为一个抽象的CTMCs涵盖了一大类的棱镜模型。然后,建立在一个理论的算法已知的首字母MM,为minorization-maximization,我们提出了迭代最大似然估计算法的参数CTMCs覆盖两个学习场景:当两个状态标签和停留时间是可观察的,或只是状态标签。最后,我们通过一个简单但不平凡的案例研究来说明我们的技术的使用:在存在封锁对策的情况下分析COVID-19的传播。

英文摘要:

Continuous-time Markov chains (CTMCs) are popular modeling formalism that constitutes the underlying semantics for real-time probabilistic systems such as queuing networks, stochastic process algebras, and calculi for systems biology. Prism and Storm are popular model checking tools that provide a number of powerful analysis techniques for CTMCs. These tools accept models expressed as the parallel composition of a number of modules interacting with each other. The outcome of the analysis is strongly dependent on the parameter values used in the model which govern the timing and probability of events of the resulting CTMC. However, for some applications, parameter values have to be empirically estimated from partially-observable executions. In this work, we address the problem of estimating parameter values of CTMCs expressed as Prism models from a number of partially-observable executions. We introduce the class parametric CTMCs -- CTMCs where transition rates are polynomial functions over a set of parameters -- as an abstraction of CTMCs covering a large class of Prism models. Then, building on a theory of algorithms known by the initials MM, for minorization-maximization, we present iterative maximum likelihood estimation algorithms for parametric CTMCs covering two learning scenarios: when both state-labels and dwell times are observable, or just state-labels are. We conclude by illustrating the use of our technique in a simple but non-trivial case study: the analysis of the spread of COVID-19 in presence of lockdown countermeasures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑