arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.12576cs.AIcs.LG
收藏

混合隐马尔可夫模型的可解释性

Towards interpretability of Mixtures of Hidden Markov Models

KTH Royal Institute of Technology(瑞典皇家理工学院)

Negar Safinianaini, Henrik Boström

摘要:

隐马尔可夫模型的混合(MHMM)经常用于序列数据的聚类。与任何聚类方法一样,MHALK的一个重要方面是它们可以解释,允许从数据中获得新的见解。然而,如果没有一个适当的方法来衡量可解释性,评价新的贡献是困难的,它变得几乎不可能设计的技术,直接优化这一属性。在这项工作中,提出了一个信息论度量(熵)的MHSTRY解释性,并在此基础上,提出了一种新的方法来提高模型的解释性,即,熵正则化期望最大化(EM)算法。新方法旨在减少MHMM中马尔可夫链(涉及状态转移矩阵)的熵,即,在聚类期间将更高的权重分配给公共状态转换。有人认为,这种熵的减少,在一般情况下,导致改善的可解释性,因为最有影响力的和重要的状态转换的集群可以更容易地确定。实证调查表明,它是可能的,以提高MHALGOT的可解释性,如熵测量,而不牺牲(而是改善)聚类性能和计算成本,如测量的V-措施和EM迭代次数,分别。

英文摘要:

Mixtures of Hidden Markov Models (MHMMs) are frequently used for clustering of sequential data. An important aspect of MHMMs, as of any clustering approach, is that they can be interpretable, allowing for novel insights to be gained from the data. However, without a proper way of measuring interpretability, the evaluation of novel contributions is difficult and it becomes practically impossible to devise techniques that directly optimize this property. In this work, an information-theoretic measure (entropy) is proposed for interpretability of MHMMs, and based on that, a novel approach to improve model interpretability is proposed, i.e., an entropy-regularized Expectation Maximization (EM) algorithm. The new approach aims for reducing the entropy of the Markov chains (involving state transition matrices) within an MHMM, i.e., assigning higher weights to common state transitions during clustering. It is argued that this entropy reduction, in general, leads to improved interpretability since the most influential and important state transitions of the clusters can be more easily identified. An empirical investigation shows that it is possible to improve the interpretability of MHMMs, as measured by entropy, without sacrificing (but rather improving) clustering performance and computational costs, as measured by the v-measure and number of EM iterations, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑