arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1704.02090cs.CLcs.IR
收藏

概念化主题建模

Conceptualization Topic Modeling

Beijing Institute of Technology(北京理工大学);South China University of Technology(华南理工大学)

Yi-Kun Tang, Xian-Ling Mao, Heyan Huang, Guihua Wen

摘要:

近年来,主题建模被广泛用于发现文本语料库中的抽象主题。现有的主题模型大多是基于三层贝叶斯结构的假设,即每个文档被建模为主题上的概率分布,每个主题是词上的概率分布。然而,这个假设并不是最优的。直观地说,假设每个主题是概念上的概率分布,然后每个概念是词上的概率分布,即在传统的三层假设中在主题层和词层之间增加一个潜在的概念层,这是更合理的。在本文中,我们验证了所提出的假设,将新的假设在两个代表性的主题模型,并获得两个新的主题模型。实验结果表明,新模型在案例分析和困惑度方面都明显优于基线模型,说明新假设比传统假设更合理。

英文摘要:

Recently, topic modeling has been widely used to discover the abstract topics in text corpora. Most of the existing topic models are based on the assumption of three-layer hierarchical Bayesian structure, i.e. each document is modeled as a probability distribution over topics, and each topic is a probability distribution over words. However, the assumption is not optimal. Intuitively, it's more reasonable to assume that each topic is a probability distribution over concepts, and then each concept is a probability distribution over words, i.e. adding a latent concept layer between topic layer and word layer in traditional three-layer assumption. In this paper, we verify the proposed assumption by incorporating the new assumption in two representative topic models, and obtain two novel topic models. Extensive experiments were conducted among the proposed models and corresponding baselines, and the results show that the proposed models significantly outperform the baselines in terms of case study and perplexity, which means the new assumption is more reasonable than traditional one.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑