RefuteBench:评估大型语言模型的反驳指令遵循能力
RefuteBench: Evaluating Refuting Instruction-Following for Large Language Models
AI总结:
本文提出RefuteBench基准,评估LLMs在问答、翻译和邮件写作任务中对用户反驳指令的遵循能力,发现模型易依赖内部知识且随对话变长会遗忘反馈,并提出召回并重复提示方法有效增强模型响应性。
摘要:
大型语言模型(LLMs)的应用范围正不断扩大。在实际使用中,用户可能会根据模型的输出提供反馈,期望模型能够根据反馈做出响应并完成回复。模型能否适当地回应用户的反驳反馈并始终如一地执行,尚未得到深入分析。鉴于此,本文提出了一个全面的基准测试RefuteBench,涵盖问答、机器翻译和电子邮件写作等任务。评估旨在考察模型能否积极接受以反驳指令形式出现的反馈,以及能否在整个对话过程中始终遵守用户要求。我们对众多LLMs进行了评估,发现LLMs表现得较为固执,即倾向于依赖其内部知识,常常未能遵从用户反馈。此外,随着对话长度的增加,模型会逐渐遗忘用户提出的反馈,并回退到自身的回复。我们进一步提出了召回并重复提示作为一种简单有效的方法,以增强模型对反馈的响应能力。
英文摘要:
The application scope of large language models (LLMs) is increasingly expanding. In practical use, users might provide feedback based on the model's output, hoping for a responsive model that can complete responses according to their feedback. Whether the model can appropriately respond to users' refuting feedback and consistently follow through with execution has not been thoroughly analyzed. In light of this, this paper proposes a comprehensive benchmark, RefuteBench, covering tasks such as question answering, machine translation, and email writing. The evaluation aims to assess whether models can positively accept feedback in form of refuting instructions and whether they can consistently adhere to user demands throughout the conversation. We conduct evaluations on numerous LLMs and find that LLMs are stubborn, i.e. exhibit inclination to their internal knowledge, often failing to comply with user feedback. Additionally, as the length of the conversation increases, models gradually forget the user's stated feedback and roll back to their own responses. We further propose a recall-and-repeat prompts as a simple and effective way to enhance the model's responsiveness to feedback.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。