arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1804.04205cs.LGcs.CLcs.IRstat.ML
收藏

使用语义局部性学习主题

Learning Topics using Semantic Locality

Syracuse University(雪城大学)

Ziyi Zhao, Krittaphat Pugdeethosapol, Sheng Lin, Zhe Li, Caiwen Ding, Yanzhi Wang, Qinru Qiu

摘要:

主题建模发现给定文本文档的潜在主题概率。为了生成更有意义的主题,更好地代表给定的文档,我们提出了一种新的特征提取技术,可用于数据预处理阶段。该方法包括三个步骤。首先,它从每个文档中生成单词/单词对。其次,采用双向TF-IDF算法对词/词对进行语义过滤。第三,利用K-means算法对语义相似的词对进行合并。实验在开放电影数据库(OMDb)、路透社数据集和20 NewsGroup数据集上进行。平均平均精度得分用作评估指标。比较我们的结果与其他国家的最先进的主题模型,如潜在的Dirichlet分配和传统的限制玻尔兹曼机。我们提出的数据预处理可以提高生成的主题准确率高达12.99%。

英文摘要:

The topic modeling discovers the latent topic probability of the given text documents. To generate the more meaningful topic that better represents the given document, we proposed a new feature extraction technique which can be used in the data preprocessing stage. The method consists of three steps. First, it generates the word/word-pair from every single document. Second, it applies a two-way TF-IDF algorithm to word/word-pair for semantic filtering. Third, it uses the K-means algorithm to merge the word pairs that have the similar semantic meaning. Experiments are carried out on the Open Movie Database (OMDb), Reuters Dataset and 20NewsGroup Dataset. The mean Average Precision score is used as the evaluation metric. Comparing our results with other state-of-the-art topic models, such as Latent Dirichlet allocation and traditional Restricted Boltzmann Machines. Our proposed data preprocessing can improve the generated topic accuracy by up to 12.99\%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑