arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.09693cs.AI
收藏

基于提示的大语言模型主题建模方法

Prompting Large Language Models for Topic Modeling

Singapore University of Design and Technology(新加坡科技设计大学);VinUniversity(文森大学);James Cook University of North Queensland(北昆士兰詹姆斯库克大学)

Han Wang, Nirmalendu Prakash, Nguyen Khoi Hoang, Ming Shan Hee, Usman Naseem, Roy Ka-Wei Lee

AI总结:

针对现有主题模型处理短文本效果差、忽略句级语义的问题,提出利用大语言模型的PromptTopic方法,通过句级提取、聚合适配预定义主题数,无需调参且在三类数据集上性能优于现有最优模型。

摘要:

主题建模是一种广泛用于揭示文本数据中潜在主题结构的技术。然而,现有模型存在一定局限性,尤其是在处理缺乏共现词的短文本数据集时表现不佳。此外,这些模型往往忽略句子层面的语义,主要聚焦于词元层面的语义。本文提出PromptTopic,这是一种新颖的主题建模方法,利用大语言模型(LLMs)的高级语言理解能力来应对上述挑战。该方法先从单篇文档中提取句子层面的主题,再将这些主题聚合、精简为预定义数量,最终为不同长度的文本生成连贯的主题。该方法无需手动调参,且能提升提取主题的质量。我们在三个差异极大的数据集上将PromptTopic与当前最优基线模型进行基准测试,证实了其在挖掘有意义主题方面的优异性能。此外,定性分析也展示了PromptTopic在多个数据集中挖掘相关主题的能力。

英文摘要:

Topic modeling is a widely used technique for revealing underlying thematic structures within textual data. However, existing models have certain limitations, particularly when dealing with short text datasets that lack co-occurring words. Moreover, these models often neglect sentence-level semantics, focusing primarily on token-level semantics. In this paper, we propose PromptTopic, a novel topic modeling approach that harnesses the advanced language understanding of large language models (LLMs) to address these challenges. It involves extracting topics at the sentence level from individual documents, then aggregating and condensing these topics into a predefined quantity, ultimately providing coherent topics for texts of varying lengths. This approach eliminates the need for manual parameter tuning and improves the quality of extracted topics. We benchmark PromptTopic against the state-of-the-art baselines on three vastly diverse datasets, establishing its proficiency in discovering meaningful topics. Furthermore, qualitative analysis showcases PromptTopic's ability to uncover relevant topics in multiple datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑