arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.06301cs.CL
收藏

基于误置信度的大语言模型上下文学习演示选择

Misconfidence-based Demonstration Selection for LLM In-Context Learning

Georgia Institute of Technology(佐治亚理工学院)

Shangqing Xu, Chao Zhang

AI总结:

本文提出上下文反思(ICR)方法,通过误置信度度量迭代选择最具挑战性的演示示例,以降低大语言模型上下文学习中的输出偏差,在五个数据集上实现平均4%的性能提升。

摘要:

大语言模型(LLMs)的上下文学习能够快速适应各种任务。然而,其成功依赖于精心选择演示示例,这在实践中仍然是一个障碍。当前解决这一问题的方法要么依赖难以获取的外部监督,要么需要频繁与LLMs交互,导致成本高昂。我们提出了一种名为上下文反思(In-Context Reflection,ICR)的新方法来克服这些挑战。ICR策略性地选择演示示例,以减少LLM输出与实际输入-输出映射之间的差异。具体而言,ICR从一组随机的初始演示开始,然后迭代地对其进行优化。在每一步中,它分析一个候选示例池,并通过一种名为误置信度(misconfidence)的新度量指标,识别出最有可能挑战LLM当前理解的示例。然后选择这些最具混淆性的示例来替换当前集合中信息量较少的演示。我们在涵盖13个子任务的五个不同数据集上进行的综合评估显示了ICR的有效性。与现有方法相比,ICR实现了平均4%的性能提升,同时展现出卓越的跨任务泛化能力。

英文摘要:

In-context learning with large language models (LLMs) excels at adapting to various tasks rapidly. However, its success hinges on carefully selecting demonstrations, which remains an obstacle in practice. Current approaches to this problem either rely on hard-to-acquire external supervision or require frequent interactions with LLMs, resulting in high costs. We propose a new method called In-Context Reflection (ICR) to overcome these challenges. ICR strategically selects demonstrations to reduce the discrepancy between the LLM's outputs and the actual input-output mappings. Specifically, ICR starts with a random set of initial demonstrations, then iteratively refines it. In each step, it analyzes a pool of candidate examples and identifies the ones most likely to challenge the LLM's current understanding, measured by a new metric called misconfidence. These most confusing examples are then selected to replace the less informative demonstrations in the current set. Our comprehensive evaluation across five diverse datasets encompassing 13 subtasks shows the efficacy of ICR. Compared to existing methods, ICR achieves an average performance boost of 4%, while demonstrating remarkable cross-task generalization capabilities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑