arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0808.0973cs.AIcs.IR
收藏

基于无监督主题模型和概念层次的文本建模

Text Modeling using Unsupervised Topic Models and Concept Hierarchies

University of California, Irvine(加州大学欧文分校)

Chaitanya Chemudugunta, Padhraic Smyth, Mark Steyvers

摘要:

统计主题模型提供了一个通用的数据驱动框架,用于从大量文本文档中自动发现高级知识。虽然主题模型可以在数据集中发现广泛的主题,但学习主题的可解释性并不总是理想的。另一方面,人类定义的概念往往在语义上更丰富,这是由于仔细选择了定义概念的单词,但它们往往不会详尽地涵盖数据集中的主题。在本文中,我们提出了一个概率框架,结合层次结构的人类定义的语义概念与统计主题模型,以寻求两全其美。使用两个不同的概念层次结构和两个集合的文本文档的实验结果表明,这种组合导致相关的语言模型的质量的系统性改进,以及使新的技术推断和可视化的文档的语义。

英文摘要:

Statistical topic models provide a general data-driven framework for automated discovery of high-level knowledge from large collections of text documents. While topic models can potentially discover a broad range of themes in a data set, the interpretability of the learned topics is not always ideal. Human-defined concepts, on the other hand, tend to be semantically richer due to careful selection of words to define concepts but they tend not to cover the themes in a data set exhaustively. In this paper, we propose a probabilistic framework to combine a hierarchy of human-defined semantic concepts with statistical topic models to seek the best of both worlds. Experimental results using two different sources of concept hierarchies and two collections of text documents indicate that this combination leads to systematic improvements in the quality of the associated language models as well as enabling new techniques for inferring and visualizing the semantics of a document.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑