arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1404.7472cs.LG
收藏

实值发射隐马尔可夫模型的谱方法实现

Implementing spectral methods for hidden Markov models with real-valued emissions

Columbia University(哥伦比亚大学);ETH Zürich(苏黎世联邦理工学院)

Carl Mattfeld

摘要:

隐马尔可夫模型(Hidden Markov Models,简称HMM)是一种广泛应用于序列数据建模的统计模型。从时间序列数据中估计出HSTH的参数是一个重要的学习问题。参数估计的主要方法是基于局部搜索算法,最著名的是期望最大化(EM)算法。这些方法容易陷入局部最优,并且经常遭受高计算和样本复杂性。近年来,出现了基于矩量法的谱方法用于干扰的参数估计。在这项工作中评估了Hsu,Kakade和Zhang 2012(arXiv:0811.4413)和Anandkumar,Hsu和Kakade 2012(arXiv:1203.0683)提出的两种谱学习算法。利用合成数据进行实验,对这些算法进行了比较。此外,频谱方法相比,鲍姆-韦尔奇算法,一个行之有效的方法应用EM算法的障碍。谱算法被发现有一个更有利的计算和样本的复杂性。即使该算法很容易处理高维观测空间,不稳定的问题,在这个政权。从实际实验数据学习的角度出发,讨论了谱方法中实值观测值的表示方法,给出了用于学习算法的数据表示方法。

英文摘要:

Hidden Markov models (HMMs) are widely used statistical models for modeling sequential data. The parameter estimation for HMMs from time series data is an important learning problem. The predominant methods for parameter estimation are based on local search heuristics, most notably the expectation-maximization (EM) algorithm. These methods are prone to local optima and oftentimes suffer from high computational and sample complexity. Recent years saw the emergence of spectral methods for the parameter estimation of HMMs, based on a method of moments approach. Two spectral learning algorithms as proposed by Hsu, Kakade and Zhang 2012 (arXiv:0811.4413) and Anandkumar, Hsu and Kakade 2012 (arXiv:1203.0683) are assessed in this work. Using experiments with synthetic data, the algorithms are compared with each other. Furthermore, the spectral methods are compared to the Baum-Welch algorithm, a well-established method applying the EM algorithm to HMMs. The spectral algorithms are found to have a much more favorable computational and sample complexity. Even though the algorithms readily handle high dimensional observation spaces, instability issues are encountered in this regime. In view of learning from real-world experimental data, the representation of real-valued observations for the use in spectral methods is discussed, presenting possible methods to represent data for the use in the learning algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑