潜在思维链真的在推理吗?一种统一的潜在推理分类法
Does Latent Chain-of-Thought Actually Reason? A Single, Unifying Taxonomy for Latent Reasoning
AI总结:
该研究通过21种模型-任务配置的实验,揭示潜在思维链的实际作用,提出分类法以统一不同潜在推理的相关研究。
摘要:
潜在思维链用连续的隐藏状态替代了书面的推理步骤,为模型提供了在给出答案前进行额外计算的步骤。目前仍不清楚这些步骤实际执行了何种计算:高任务准确率和可解码的中间答案并不能证明模型利用其潜在思维链得出了答案。我们在覆盖三种训练方案、三种推理任务和两种主干模型的21种模型-任务配置中研究了这一问题,结合思维链删除、内容替换与探测、轨迹分析,以测试该链是否影响答案、其编码内容以及状态如何变化。在逻辑任务上,COCONUT通常携带在思维链开始前就已可读的答案;其状态很早就稳定下来,删除思维链后预测几乎不变;逐步监督会产生有序的推理步骤布局,可使模型依赖思维链,但即便有序的思维链也可能充当占位符——删除会损害性能,而内容替换却不会改变答案。在算术任务上,所有测试的训练方案均显示对思维链内容存在依赖。这些结果表明,仅可读的潜在状态不足以作为推理的证据。我们引入一种分类法,将思维链所代表的内容与模型如何使用它区分开来;从该视角看,早期的报告不再相互冲突:占位符 token、坍缩叠加态和依赖步骤的因果角色分别与不同类型的思维链一致,这些思维链是在不同任务、训练方案或测量方式下获得的。一旦研究明确其测试的属性(模型是否使用思维链、思维链包含什么、其状态如何变化),关于潜在推理的主张就可以相互比较。
英文摘要:
Latent chain-of-thought replaces written reasoning steps with continuous hidden states, giving models additional steps to compute before answering. It remains unclear what computation these steps actually perform. High task accuracy and decodable intermediate answers do not establish that a model uses its latent chain to reach an answer. We study this question across twenty-one model-task configurations covering three training recipes, three reasoning tasks, and two backbones. We combine chain deletion and content replacement with probes and trajectory analysis to test whether the chain affects the answer, what it encodes, and how its states change. On logical tasks, COCONUT often carries an answer that is already readable before the chain begins. Its states settle early, and deleting the chain leaves predictions almost unchanged. Per-step supervision produces an ordered layout of reasoning steps and can make the model depend on the chain. Yet even an ordered chain can act as a placeholder, with deletion hurting performance while content replacement leaves answers unchanged. On arithmetic tasks, all tested recipes show dependence on chain content. These results show why readable latent states alone are insufficient evidence of reasoning. We introduce a taxonomy that separates what a chain represents from how the model uses it. Seen this way, earlier reports no longer compete: placeholder tokens, collapsed superposition and step-dependent causal roles are each consistent with a different kind of chain, each obtained on a different task, training recipe or measurement. Once a study says which property it tested, whether the model uses the chain, what the chain holds, or how its state moves, claims about latent reasoning can be compared.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。