推理中逻辑的断裂:通过控制LLM推理链中的逻辑连接词进行逻辑感知路径选择
Where Reasoning Breaks: Logic-Aware Path Selection by Controlling Logical Connectives in LLMs Reasoning Chains
AI总结:
本文研究LLM在多步逻辑推导中的脆弱性,提出通过干预逻辑连接词选择来提升推理准确性,采用多层框架优化逻辑关键节点,实现准确率与效率的平衡。
摘要:
尽管LLM展现出出色的推理能力,但在多步逻辑推导中仍存在脆弱性,单个转换错误可能扩散至整个推理链,导致性能不稳定。本文识别逻辑连接词为结构脆弱性的关键点,通过实证分析发现连接词令牌作为高熵分叉点,模型常难以确定正确逻辑方向。受此启发,我们假设干预逻辑连接词选择可引导LLM朝更正确的逻辑方向发展。为此,我们提出一个多层框架,专门干预推理过程中的逻辑关键节点。该框架包括(1)基于梯度的逻辑引导,引导LLM内部表示向有效推理子空间发展;(2)局部分支,通过针对性的前瞻搜索解决歧义;(3)目标转换偏好优化,一种针对逻辑转折点的强化学习目标,选择性优化单个令牌偏好。关键在于,通过仅在逻辑关键转换上集中干预,我们的框架在准确率与效率之间实现了优于全局推理时间扩展方法(如束搜索和自一致性)的平衡。
英文摘要:
While LLMs demonstrate impressive reasoning capabilities, they remain fragile in multi-step logical deduction, where a single transition error can propagate through the entire reasoning chain, leading to unstable performance. In this work, we identify logical connectives as primary points of this structural fragility. Through empirical analysis, we show that connective tokens function as high entropy forking points, at which models frequently struggle to determine the correct logical direction. Motivated by this observation, we hypothesize that intervening in logical connective selection can guide LLMs toward more correct logical direction, thereby improving the overall reasoning chain. To validate this hypothesis, we propose a multi-layered framework that intervenes specifically at these logic-critical junctions in the reasoning process. Our framework includes (1) Gradient-based Logical Steering to guide LLMs internal representations towards valid reasoning subspaces, (2) Localized Branching to resolve ambiguity via targeted look-ahead search, and (3) Targeted Transition Preference Optimization, a surgical reinforcement learning objective that selectively optimizes single-token preferences at logical pivots. Crucially, by concentrating intervention solely on logic-critical transitions, our framework achieves a favorable accuracy--efficiency trade-off compared to global inference time scaling methods like beam search and self-consistency.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。