arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1802.09656stat.ML
收藏

二元潜变量模型的张量特征对学习方法

Learning Binary Latent Variable Models: A Tensor Eigenpair Approach

Ariel Jaffe, Roi Weiss, Shai Carmi, Yuval Kluger, Boaz Nadler

摘要:

隐二进制单位的潜变量模型出现在各种应用中。学习这样的模型,特别是在存在噪声的情况下,是一个具有挑战性的计算问题。在本文中,我们提出了一种新的谱方法来解决这个问题,基于观测数据的二阶矩矩阵和三阶矩张量的特征向量。我们证明了在温和的非退化条件下,我们的方法一致地估计模型参数的最佳参数率。我们的基于张量的方法概括了以前的正交张量分解方法,其中隐藏单元被假设为统计独立或相互排斥。我们说明了我们的方法模拟数据的一致性,并证明了它的有用性,在遗传学中的人口混合物的一个共同的模型学习。

英文摘要:

Latent variable models with hidden binary units appear in various applications. Learning such models, in particular in the presence of noise, is a challenging computational problem. In this paper we propose a novel spectral approach to this problem, based on the eigenvectors of both the second order moment matrix and third order moment tensor of the observed data. We prove that under mild non-degeneracy conditions, our method consistently estimates the model parameters at the optimal parametric rate. Our tensor-based method generalizes previous orthogonal tensor decomposition approaches, where the hidden units were assumed to be either statistically independent or mutually exclusive. We illustrate the consistency of our method on simulated data and demonstrate its usefulness in learning a common model for population mixtures in genetics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑