arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.00093cs.CLcs.AI
收藏

大型语言模型容易被无关上下文干扰

Large Language Models Can Be Easily Distracted by Irrelevant Context

Google DeepMind(谷歌DeepMind);Toyota Technological Institute at Chicago(芝加哥丰田理工学院);Purdue University(普渡大学)

Freda Shi, Xinyun Chen, Kanishka Misra, Nathan Scales, David Dohan, Ed Chi, Nathanael Schärli, Denny Zhou

AI总结:

本文构建含无关信息的算术推理数据集 GSM-IC,评估前沿提示方法,发现无关上下文会显著降低大型语言模型性能,并提出自洽性解码与忽略无关信息提示等缓解方案。

摘要:

大型语言模型已在各类自然语言处理任务上取得令人瞩目的性能。然而,迄今为止,对它们的评估主要集中在输入上下文中所有信息都与解决任务相关的基准上。在本研究中,我们调查大型语言模型的易受干扰性,即模型解决问题的准确率会如何受到无关上下文的影响。具体而言,我们提出了 Grade-School Math with Irrelevant Context(GSM-IC,含无关上下文的小学数学题),这是一个在题目描述中包含无关信息的算术推理数据集。我们利用该基准衡量面向大型语言模型的前沿提示技术的易受干扰性,发现当加入无关信息时,模型性能会显著下降。我们还找出了若干缓解这一缺陷的方法,例如采用 self-consistency(自洽性)解码,以及在提示中加入一条指示,要求语言模型忽略无关信息。

英文摘要:

Large language models have achieved impressive performance on various natural language processing tasks. However, so far they have been evaluated primarily on benchmarks where all information in the input context is relevant for solving the task. In this work, we investigate the distractibility of large language models, i.e., how the model problem-solving accuracy can be influenced by irrelevant context. In particular, we introduce Grade-School Math with Irrelevant Context (GSM-IC), an arithmetic reasoning dataset with irrelevant information in the problem description. We use this benchmark to measure the distractibility of cutting-edge prompting techniques for large language models, and find that the model performance is dramatically decreased when irrelevant information is included. We also identify several approaches for mitigating this deficiency, such as decoding with self-consistency and adding to the prompt an instruction that tells the language model to ignore the irrelevant information.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑