arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.19281cs.AI
收藏

有限推理空间:LLMs中长视图推理的牢笼

Limited Reasoning Space: The cage of long-horizon reasoning in LLMs

Zhenyu Li, Guanlin Wu, Cheems Wang, Yongqiang Zhao

AI总结:

本文提出Halo框架,通过熵驱动的双控制器实现可控推理,解决LLM长视图任务中的推理限制问题。

摘要:

测试时间计算策略,如链式思维(CoT),已显著增强了大型语言模型解决复杂任务如逻辑推理的能力。然而,实证研究表明,当采用典型任务分解策略如CoT时,单纯增加计算预算有时会导致测试时间性能的崩溃。本文假设在更大的计算预算下推理失败源于静态规划方法,这些方法难以感知LLM推理的内在边界。我们称之为有限推理空间假设,并通过非自主随机动力系统的方法进行理论分析。这一见解表明,计算预算有一个最佳范围;过度规划可能导致冗余反馈,甚至可能损害推理能力。为利用计算扩展收益并抑制过度规划,本文提出Halo,一种为LLM规划设计的模型预测控制框架。Halo专为长视图任务设计,采用基于推理的规划,并构建了一个熵驱动的双控制器,采用测量后再规划策略以实现可控推理。实验结果表明,Halo在复杂长视图任务上优于静态基线,通过在推理边界动态调节规划。

英文摘要:

The test-time compute strategy, such as Chain-of-Thought (CoT), has significantly enhanced the ability of large language models to solve complex tasks like logical reasoning. However, empirical studies indicate that simply increasing the compute budget can sometimes lead to a collapse in test-time performance when employing typical task decomposition strategies such as CoT. This work hypothesizes that reasoning failures with larger compute budgets stem from static planning methods, which hardly perceive the intrinsic boundaries of LLM reasoning. We term it as the Limited Reasoning Space hypothesis and perform theoretical analysis through the lens of a non-autonomous stochastic dynamical system. This insight suggests that there is an optimal range for compute budgets; over-planning can lead to redundant feedback and may even impair reasoning capabilities. To exploit the compute-scaling benefits and suppress over-planning, this work proposes Halo, a model predictive control framework for LLM planning. Halo is designed for long-horizon tasks with reason-based planning and crafts an entropy-driven dual controller, which adopts a Measure-then-Plan strategy to achieve controllable reasoning. Experimental results demonstrate that Halo outperforms static baselines on complex long-horizon tasks by dynamically regulating planning at the reasoning boundary.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑