arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.13550cs.CL
收藏

基于术语社区的变分辨率主题检测

Term-community-based topic detection with variable resolution

German Aerospace Center (DLR)(德国航空航天中心)

Andreas Hamm, Simon Odrowski

摘要:

基于网络的过程中的主题检测在巨大的文本集合提供了一个直观的替代概率主题模型。我们详细介绍了一种方法,特别是设计领域专家的要求。类似的方法,它采用社区发现在长期共现图,但它是通过包括一个决议参数,可用于改变目标的主题粒度增强。我们还建立了一个长期的排名,并使用语义词嵌入呈现长期社区的方式,方便他们的解释。我们展示了我们的方法与广泛使用的一般新闻文章的语料库的应用,并显示在各种分辨率的检测主题的详细的社会科学专家评估的结果。还包括与潜在狄利克雷分配检测到的主题的比较。最后,我们讨论了影响主题解释的因素。

英文摘要:

Network-based procedures for topic detection in huge text collections offer an intuitive alternative to probabilistic topic models. We present in detail a method that is especially designed with the requirements of domain experts in mind. Like similar methods, it employs community detection in term co-occurrence graphs, but it is enhanced by including a resolution parameter that can be used for changing the targeted topic granularity. We also establish a term ranking and use semantic word-embedding for presenting term communities in a way that facilitates their interpretation. We demonstrate the application of our method with a widely used corpus of general news articles and show the results of detailed social-sciences expert evaluations of detected topics at various resolutions. A comparison with topics detected by Latent Dirichlet Allocation is also included. Finally, we discuss factors that influence topic interpretation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑