arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.03332cs.CLcs.AIcs.LG

脆弱的思考:大型语言模型如何处理推理链扰动

Fragile Thoughts: How Large Language Models Handle Chain-of-Thought Perturbations

University of Southern California(南加州大学);Information Sciences Institute(信息科学研究所)

Ashwath Vaithinathan Aravindan, Mayank Kejriwal

AI总结:

本文研究了大型语言模型在推理链扰动下的鲁棒性,通过五种扰动类型评估13种模型,发现不同扰动对模型的影响各异,模型规模在某些扰动中起到保护作用。

摘要:

链式推理(CoT)提示法已成为引导大型语言模型(LLMs)进行推理的基础技术,但其在中间推理步骤中的鲁棒性仍缺乏深入理解。本文对LLMs在五种结构化的CoT扰动类型(MathError、UnitConversion、Sycophancy、SkippedSteps和ExtraSteps)下的鲁棒性进行了全面实证评估。我们评估了13种模型,涵盖参数量三个数量级的范围,测试其在注入推理链扰动的情况下完成数学推理任务的能力。关键发现揭示了异质性的脆弱性模式:MathError扰动在小型模型中导致最严重的降级(50-60%的准确率损失),但显示出强规模效益;UnitConversion在所有规模上都具有挑战性(即使在中等规模模型上也超过5%的损失);ExtraSteps导致的准确率降级极小(0-6%),即使在最小模型中也是如此;Sycophancy和SkippedSteps产生适度影响(小型模型约10%的损失),并且随着规模增加略有改善。规模关系显示,模型规模在许多扰动中起到保护作用,但并非总是如此。这些发现对部署LLMs在多阶段推理管道中具有直接意义,并强调了任务特定的鲁棒性评估和缓解策略的必要性。代码和结果可在https://github.com/Mystic-Slice/CoTPerturbation获取。

英文摘要:

Chain-of-Thought (CoT) prompting has emerged as a foundational technique for eliciting reasoning from Large Language Models (LLMs), yet the robustness of this approach to corruptions in intermediate reasoning steps remains poorly understood. This paper presents a comprehensive empirical evaluation of LLM robustness to a structured taxonomy of 5 CoT perturbation types: \textit{MathError, UnitConversion, Sycophancy, SkippedSteps,} and \textit{ExtraSteps}. We evaluate 13 models spanning three orders of magnitude in parameter count, testing their ability to complete mathematical reasoning tasks despite perturbations injected in the reasoning chain. Our key findings reveal heterogeneous vulnerability patterns: MathError perturbations produce the most severe degradation in small models (50-60\% accuracy loss) but show strong scaling benefits; UnitConversion remains challenging across all scales (>5\% loss even for midsized models); ExtraSteps incur minimal accuracy degradation (0-6\%) even for the smallest of models; Sycophancy and SkippedSteps produce modest effects ($\sim$10\% loss for small models) and slightly improve with scale. Scaling relationships show that model size serve as a protective factor against many perturbations but not always. These findings have direct implications for deploying LLMs in multi-stage reasoning pipelines and underscore the necessity of task-specific robustness assessments and mitigation strategies. The code and results are available at https://github.com/Mystic-Slice/CoTPerturbation

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑