arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2205.01845cs.CLcs.IR
收藏

利用词表外种子词进行种子引导的主题发现

Seed-Guided Topic Discovery with Out-of-Vocabulary Seeds

University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Washington(华盛顿大学)

Yu Zhang, Yu Meng, Xuan Wang, Sheng Wang, Jiawei Han

AI总结:

针对种子引导主题发现难以处理词表外种子词且未利用 PLM 的问题,提出 SeeTopic 框架,融合 PLM 通用知识与语料局部语义,并在三个数据集上验证其有效性。

摘要:

从文本语料库中发现潜在主题已经研究了数十年。许多现有主题模型采用完全无监督的设置,由于无法利用用户引导,它们发现的主题可能无法满足用户的特定兴趣。尽管已有一些种子引导的主题发现方法利用用户提供的种子词来发现具有主题代表性的术语,但它们较少关注两个因素:(1)词表外种子词的存在;(2)预训练语言模型(PLM)的能力。本文将种子引导主题发现任务推广到允许词表外种子词的情形。我们提出了一个名为 SeeTopic 的新颖框架,在该框架中,PLM 的通用知识与从输入语料库学习到的局部语义可以相互受益。在来自不同领域的三个真实数据集上进行的实验,从主题一致性、准确性和多样性方面证明了 SeeTopic 的有效性。

英文摘要:

Discovering latent topics from text corpora has been studied for decades. Many existing topic models adopt a fully unsupervised setting, and their discovered topics may not cater to users' particular interests due to their inability of leveraging user guidance. Although there exist seed-guided topic discovery approaches that leverage user-provided seeds to discover topic-representative terms, they are less concerned with two factors: (1) the existence of out-of-vocabulary seeds and (2) the power of pre-trained language models (PLMs). In this paper, we generalize the task of seed-guided topic discovery to allow out-of-vocabulary seeds. We propose a novel framework, named SeeTopic, wherein the general knowledge of PLMs and the local semantics learned from the input corpus can mutually benefit each other. Experiments on three real datasets from different domains demonstrate the effectiveness of SeeTopic in terms of topic coherence, accuracy, and diversity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑