arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2603.22754cs.CL
收藏

PRISM:通过语义流和潜在计算双重视角分析LLM推理

PRISM: A Dual View of LLM Reasoning through Semantic Flow and Latent Computation

Rice University(里士大学);Stony Brook University(石溪大学)

Ruidi Chang, Jiawei Zhou, Hanjie Chen

AI总结:

PRISM通过同时分析推理步骤和层的语义流与潜在计算,揭示LLM推理过程中的系统性模式,展示失败轨迹易陷入无效验证循环并转向不同模式,为分析LLM推理过程提供实用工具。

摘要:

大型语言模型(LLM)通过生成多步骤推理轨迹来解决复杂问题。然而,这些轨迹通常仅从两种视角之一进行分析:生成文本中不同推理步骤的token序列,或模型层内单步的隐藏状态向量。我们引入PRISM(通过语义和隐含建模的概率推理检查),一种框架和诊断工具,用于同时分析这两个层面,提供推理在步骤和层之间演变的统一视角。在多个推理模型和基准测试中,PRISM揭示了推理过程中的系统性模式,表明失败轨迹更可能陷入无生产力的验证循环,并进一步转向不同的模式,如过度思考和过早承诺,一旦达到候选答案,这些模式表现不同。它进一步揭示了提示如何通过改变语义转换和内部计算模式来重塑推理行为,超越了聚合准确性。通过将推理轨迹建模为结构化过程,PRISM使这些行为变得可观测和可分析,而不是仅依赖最终任务准确性。总体而言,这些见解使PRISM成为分析和诊断LLM推理过程的实用工具。

英文摘要:

Large language models (LLMs) solve complex problems by generating multi-step reasoning traces. Yet these traces are typically analyzed from only one of two perspectives: the sequence of tokens across different reasoning steps in the generated text, or the hidden-state vectors across model layers within one step. We introduce PRISM (Probabilistic Reasoning Inspection through Semantic and Implicit Modeling), a framework and diagnostic tool for jointly analyzing both levels, providing a unified view of how reasoning evolves across steps and layers. Across multiple reasoning models and benchmarks, PRISM uncovers systematic patterns in the reasoning process, showing that failed trajectories are more likely to become trapped in unproductive verification loops and further diverge into distinct modes such as overthinking and premature commitment, which behave differently once a candidate answer is reached. It further reveals how prompting reshapes reasoning behavior beyond aggregate accuracy by altering both semantic transitions and internal computational patterns. By modeling reasoning trajectories as structured processes, PRISM makes these behaviors observable and analyzable rather than relying solely on final-task accuracy. Taken together, these insights position PRISM as a practical tool for analyzing and diagnosing reasoning processes in LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑