Alice in Wonderland:简单任务揭示最先进大型语言模型中完全的推理崩溃
Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Models
AI总结:
本文提出AIW问题,揭示SOTA LLMs在简单常识数学推理上的严重崩溃,表明现有基准存在缺陷,亟需建立新评估标准。
摘要:
大型语言模型(LLMs)通常被描述为具有遵循缩放定律的强泛化能力的基础模型实例,因此能够以少样本或零样本方式在各种条件下稳健迁移。这些主张依赖于旨在测量泛化和推理能力的标准化基准,在这些基准上,最先进的(SOTA)模型得分很高。我们在此展示了一个简单、简短的常识数学问题(AIW问题),该问题用简洁的自然语言表述,人类很容易解决,却导致了所有声称具有强大功能的SOTA模型(包括GPT-4或Claude 3 Opus等大规模先进模型)在泛化和基本推理上发生剧烈崩溃。这种崩溃是戏剧性的,因为它在一个简单问题上表现为平均性能极低,并且在完全不改变问题结构或难度的自然模板变体上表现出强烈的性能波动。通过在具有相似形式的进一步控制问题上测试模型,我们排除了崩溃可能源于自然语言或数字解析等次要低级问题的可能性。我们还观察到模型对错误解决方案表现出强烈的过度自信,以听起来合理的解释性虚构形式表达。尝试获得正确解决方案的各种标准干预措施均告失败,如思维链提示,或敦促模型通过多步重新评估重新考虑错误解决方案。我们利用这些观察结果来促使人们重新评估标准化基准所声称的当前一代LLMs的能力。这种重新评估还需要采取共同行动来创建标准化基准,以便能够正确检测出当前最先进的评估程序显然未能发现的泛化和推理缺陷,在这些评估程序中,SOTA LLMs仍能获得高分。代码:https://github.com/LAION-AI/AIW
英文摘要:
Large Language Models (LLMs) are often described as instances of foundation models that possess strong generalization obeying scaling laws, and therefore transfer robustly across various conditions in few- or zero-shot manner. Such claims rely on standardized benchmarks that suppose to measure generalization and reasoning, where state-of-the-art (SOTA) models score high. We demonstrate here a dramatic breakdown of generalization and basic reasoning of all SOTA models claiming strong function, including large scale advanced models like GPT-4 or Claude 3 Opus, using a simple, short common sense math problem formulated in concise natural language, easily solvable by humans (AIW problem). The breakdown is dramatic as it manifests on a simple problem in both low average performance and strong performance fluctuations on natural variations in problem template that do not change either problem structure or its difficulty at all. By testing models on further control problems with similar form, we rule out that breakdown might be rooted in minor low-level issues like natural language or numbers parsing. We also observe strong overconfidence in the wrong solutions, expressed in form of plausible sounding explanation-like confabulations. Various standard interventions in an attempt to get the right solution, like chain-of-thought prompting, or urging the models to reconsider the wrong solutions again by multi step re-evaluation, fail. We use these observations to stimulate re-assessment of the capabilities of current generation of LLMs as claimed by standardized benchmarks. Such re-assessment also requires common action to create standardized benchmarks that would allow proper detection of such deficits in generalization and reasoning that obviously remain undiscovered by current state-of-the-art evaluation procedures, where SOTA LLMs manage to score high. Code: https://github.com/LAION-AI/AIW
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。