arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1301.6705cs.LGcs.IRstat.ML
收藏

概率潜在语义分析

Probabilistic Latent Semantic Analysis

EECS Department, Computer Science Division, University of California, Berkeley(加州大学伯克利分校电子工程与计算机科学系,计算机科学分部);International Computer Science Institute(国际计算机科学研究所)

Thomas Hofmann

摘要:

概率潜在语义分析(ProbabilityLatentSemantic Analysis)是一种新的统计技术,用于分析双模式和共现数据,在信息检索和过滤、自然语言处理、文本机器学习等相关领域有着广泛的应用。相比标准的潜在语义分析,源于线性代数,并执行一个奇异值分解的同现表,所提出的方法是基于一个混合物分解来自一个潜在的类模型。这就产生了一种更有原则的方法,它在统计学方面有着坚实的基础。为了避免过拟合,我们提出了一个广泛适用的推广的最大似然模型拟合的回火EM。我们的方法产生大量的和一致的改进,在一些实验中的潜在语义分析。

英文摘要:

Probabilistic Latent Semantic Analysis is a novel statistical technique for the analysis of two-mode and co-occurrence data, which has applications in information retrieval and filtering, natural language processing, machine learning from text, and in related areas. Compared to standard Latent Semantic Analysis which stems from linear algebra and performs a Singular Value Decomposition of co-occurrence tables, the proposed method is based on a mixture decomposition derived from a latent class model. This results in a more principled approach which has a solid foundation in statistics. In order to avoid overfitting, we propose a widely applicable generalization of maximum likelihood model fitting by tempered EM. Our approach yields substantial and consistent improvements over Latent Semantic Analysis in a number of experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑