大语言模型在选项长度、问题类型和无关名词替换下泛化能力严重不足
Large Language Models Badly Generalize across Option Length, Problem Types, and Irrelevant Noun Replacements
AI总结:
本文通过泛化压力测试发现大语言模型在选项长度、问题类型和无关名词替换等微小扰动下准确率大幅下降,表明其依赖表面线索而非鲁棒抽象表示。
摘要:
本文提出了一种“泛化压力测试”,用于评估大语言模型(LLMs)在轻微且受控的扰动下的泛化能力,扰动包括选项长度、问题类型和无关名词替换。我们取得了新颖且重要的发现:尽管基准测试得分很高,LLMs在面对这些微小但保持内容的修改时,仍表现出严重的准确率下降和意外偏差(例如,偏好更长的干扰项)。例如,在不改变问题的情况下改变选项长度时,Qwen 2.5 1.5B的MMLU得分从60上升到89,又从89下降到36。即使是GPT4o,在问题类型改变时也损失了25个百分点的准确率,在全部三类修改下平均下降6个百分点。这些分析表明,LLMs严重依赖表面线索,而不是形成能够跨格式、词汇变化和无关内容变化进行泛化的鲁棒抽象表示。
英文摘要:
In this paper, we propose a ``Generalization Stress Test" to assess Large Language Models' (LLMs) generalization ability under slight and controlled perturbations, including option length, problem types, and irrelevant noun replacements. We achieve novel and significant findings that, despite high benchmark scores, LLMs exhibit severe accuracy drops and unexpected biases (e.g., preference for longer distractors) when faced with these minor but content-preserving modifications. For example, Qwen 2.5 1.5B's MMLU score rises from 60 to 89 and drops from 89 to 36 when option lengths are changed without altering the question. Even GPT4o experiences a 25-point accuracy loss when problem types are changed, with a 6-point drop across all three modification categories. These analyses suggest that LLMs rely heavily on superficial cues rather than forming robust, abstract representations that generalize across formats, lexical variations, and irrelevant content shifts.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。