arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2010.05341eess.SYcs.SYmath.OC
收藏

马氏链集结中超状态数的确定与限定

On Determining and Qualifying the Number of Superstates in Aggregation of Markov Chains

Amber Srivastava, Raj K. Velicheti, Srinivasa M. Salapaka

摘要:

许多涉及大型马尔可夫链的研究需要确定一个较小的代表(聚集)链。代表性链中的每个{ \em超状态}表示原始马尔可夫链中的{ \em相关组}状态。通常,聚合链中超状态数量的选择是模糊的,并且基于有限的先验知识。在本文中,我们提出了一个结构化的方法来确定最佳候选人的超状态的数量。我们通过比较不同大小的聚合链来实现这一点。为了便于比较,我们提出并量化了{ \em边际收益}的概念。我们的概念捕获了{ \em相关}状态组内的{ \em异质性}的降低(即,由相同超状态表示的状态)。我们使用最大熵原理来证明边际收益的概念,以及我们的量化的异质性。通过模拟的合成马尔可夫链,其中的超状态的数量是已知的先验,我们表明,聚合链的最大边际收益确定这个数字。在马尔可夫链的情况下,模拟现实生活中的情况下,我们表明,具有最大边际收益的聚合模型确定了一个固有的结构独特的情况下建模,因此,证实了我们提出的方法的有效性。

英文摘要:

Many studies involving large Markov chains require determining a smaller representative (aggregated) chains. Each {\em superstate} in the representative chain represents a {\em group of related} states in the original Markov chain. Typically, the choice of number of superstates in the aggregated chain is ambiguous, and based on the limited prior know-how. In this paper we present a structured methodology of determining the best candidate for the number of superstates. We achieve this by comparing aggregated chains of different sizes. To facilitate this comparison we develop and quantify a notion of {\em marginal return}. Our notion captures the decrease in the {\em heterogeneity} within the group of the {\em related} states (i.e., states represented by the same superstate) upon a unit increase in the number of superstates in the aggregated chain. We use Maximum Entropy Principle to justify the notion of marginal return, as well as our quantification of heterogeneity. Through simulations on synthetic Markov chains, where the number of superstates are known apriori, we show that the aggregated chain with the largest marginal return identifies this number. In case of Markov chains that model real-life scenarios we show that the aggregated model with the largest marginal return identifies an inherent structure unique to the scenario being modelled; thus, substantiating on the efficacy of our proposed methodology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑