We consider probabilistic systems with hidden state and unobservable transitions, an extension of Hidden Markov Models (HMMs) that in particular admits unobservable ε-transitions (also called null transitions), allowing state changes of which the observer is unaware. Due to the presence of ε-loops this additional feature complicates the theory and requires to carefully set up the corresponding probability space and random variables. In particular we present an algorithm for determining the most probable explanation given an observation (a generalization of the Viterbi algorithm for HMMs) and a method for parameter learning that adapts the probabilities of a given model based on an observation (a generalization of the Baum-Welch algorithm). The latter algorithm guarantees that the given observation has a higher (or equal) probability after adjustment of the parameters and its correctness can be derived directly from the so-called EM algorithm.
Expressive power of tensor-network factorizations for probabilistic modeling, with applications from hidden Markov models to quantum machine learning
Max-Planck-Institut für Quantenoptik(马克斯·普朗克量子光学研究所);Munich Center for Quantum Science and Technology (MCQST)(慕尼黑量子科学与技术中心(MCQST));Dahlem Center for Complex Quantum Systems, Freie Universität Berlin(柏林自由大学达勒姆复杂量子系统中心);Freie Universität Berlin(柏林自由大学)
Quick Adaptive Ternary Segmentation: An Efficient Decoding Procedure For Hidden Markov Models
Nonclinical Biostatistics, F. Hoffmann-La Roche, Switzerland(非临床生物统计学,霍夫曼拉罗奇公司,瑞士);Institute for Mathematical Stochastics, Cluster of Excellence “Multiscale Bioimaging: from Molecular Machines to Networks of Excitable Cells”(数学概率研究所,卓越中心“多尺度生物成像:从分子机器到可兴奋细胞网络”);Georg-August-Universität Göttingen, Germany(哥廷根大学,德国)
Expressiveness and Learning of Hidden Quantum Markov Models
University of Washington(华盛顿大学);Microsoft Research(微软研究院);Georgia Institute of Technology(佐治亚理工学院)
扩展经典的概率推理,使用量子力学的概率观点一直是最近的兴趣,特别是在隐量子马尔可夫模型(HQMRM)的发展,建模随机过程。然而,在描述这些模型的表现力和从数据中学习它们方面几乎没有进展。我们解决这些问题表明,HQOMM是一个特殊的子类的一般类的可观察的运营商模型(OOM),不遭受的\emph{negative probability problem}的设计。我们还提供了一个可行的回缩为基础的学习算法HQSHELL使用受约束的梯度下降模型参数的Stiefel流形。我们证明了这种方法比以前的学习算法更快,并且可以扩展到更大的模型。