arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.20081cs.CLcs.AIcs.IR

通过大语言模型整合摘要与检索以增强个性化

Integrating Summarization and Retrieval for Enhanced Personalization via Large Language Models

Georgia Institute of Technology(佐治亚理工学院);Amazon Alexa AI(亚马逊Alexa AI)

Chris Richardson, Yao Zhang, Kellen Gillespie, Sudipta Kar, Arshdeep Singh, Zeynab Raeesy, Omar Zia Khan, Abhinav Sethy

AI总结:

本文提出一种摘要增强个性化方法,利用大语言模型离线生成任务感知的用户摘要,并与运行时检索结合,在减少75%检索数据的情况下,在LaMP基准上达到或超越现有检索增强方法的个性化性能。

摘要:

个性化,即让系统能够针对个体用户进行定制的能力,是自然语言处理(NLP)系统用户体验中的一个关键因素。随着大语言模型(LLMs)的出现,一个核心问题是如何利用这些模型来更好地个性化用户体验。为了使语言模型的输出个性化,一种直接的方法是将过去的用户数据纳入语言模型提示中,但这种方法可能导致输入过长,超出输入长度限制,并带来延迟和成本问题。现有方法通过选择性地提取相关用户数据(即选择性检索)来构建下游任务的提示,以应对这些挑战。然而,基于检索的方法受到潜在信息丢失、缺乏更深入的用户理解以及冷启动挑战的限制。为了克服这些局限性,我们提出了一种新颖的摘要增强方法,通过使用LLMs生成的任务感知用户摘要来扩展检索增强个性化。这些摘要可以离线生成和存储,使具有运行时约束的现实系统(如语音助手)能够利用LLMs的能力。实验表明,在LaMP个性化基准的大多数任务上,我们的方法在检索到的用户数据减少75%的情况下,与检索增强方法性能相当或更优。我们证明,通过LLMs进行离线摘要和运行时检索,可以在实际约束下在一系列任务上实现更好的个性化性能。

英文摘要:

Personalization, the ability to tailor a system to individual users, is an essential factor in user experience with natural language processing (NLP) systems. With the emergence of Large Language Models (LLMs), a key question is how to leverage these models to better personalize user experiences. To personalize a language model's output, a straightforward approach is to incorporate past user data into the language model prompt, but this approach can result in lengthy inputs exceeding limitations on input length and incurring latency and cost issues. Existing approaches tackle such challenges by selectively extracting relevant user data (i.e. selective retrieval) to construct a prompt for downstream tasks. However, retrieval-based methods are limited by potential information loss, lack of more profound user understanding, and cold-start challenges. To overcome these limitations, we propose a novel summary-augmented approach by extending retrieval-augmented personalization with task-aware user summaries generated by LLMs. The summaries can be generated and stored offline, enabling real-world systems with runtime constraints like voice assistants to leverage the power of LLMs. Experiments show our method with 75% less of retrieved user data is on-par or outperforms retrieval augmentation on most tasks in the LaMP personalization benchmark. We demonstrate that offline summarization via LLMs and runtime retrieval enables better performance for personalization on a range of tasks under practical constraints.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑