arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.00909cs.IRcs.AI
收藏

LLM-TAKE:使用大语言模型的主题感知关键词提取

LLM-TAKE: Theme Aware Keyword Extraction Using Large Language Models

Walmart Global Tech(沃尔玛全球技术)

Reza Yousefi Maragheh, Chenhao Fang, Charan Chand Irugu, Parth Parikh, Jason Cho, Jianpeng Xu, Saranyan Sukumar, Malay Patel, Evren Korpeoglu, Sushant Kumar, Kannan Achan

AI总结:

本文提出LLM-TAKE框架,利用大语言模型从商品元数据中提取主题感知关键词,通过多阶段细化减少幻觉,并在三个真实数据集上验证其提升准确性与多样性。

摘要:

关键词提取是自然语言处理中的核心任务之一。经典提取模型因注意力跨度短而闻名,这使得它们难以推断相距较远的词和句子之间的关联关系,进而导致它们无法用于生成从全文上下文中推断出的关键词。在本文中,我们探索使用大语言模型(LLMs)为从商品文本元数据中推断出的项目生成关键词。我们的建模框架包含多个阶段,通过避免输出无信息或敏感的关键词,并减少LLM中常见的幻觉,来细化结果。我们将基于LLM的框架称为主题感知关键词提取(LLM TAKE)。我们提出了该框架的两种变体,用于在电子商务环境中为产品生成抽取式和抽象式主题。我们在三个真实数据集上进行了大量实验,结果表明与基准模型相比,我们的建模框架能够提升基于准确性和基于多样性的指标。

英文摘要:

Keyword extraction is one of the core tasks in natural language processing. Classic extraction models are notorious for having a short attention span which make it hard for them to conclude relational connections among the words and sentences that are far from each other. This, in turn, makes their usage prohibitive for generating keywords that are inferred from the context of the whole text. In this paper, we explore using Large Language Models (LLMs) in generating keywords for items that are inferred from the items textual metadata. Our modeling framework includes several stages to fine grain the results by avoiding outputting keywords that are non informative or sensitive and reduce hallucinations common in LLM. We call our LLM-based framework Theme-Aware Keyword Extraction (LLM TAKE). We propose two variations of framework for generating extractive and abstractive themes for products in an E commerce setting. We perform an extensive set of experiments on three real data sets and show that our modeling framework can enhance accuracy based and diversity based metrics when compared with benchmark models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑