arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.02170cs.AI
收藏

流式长推理链中的幻觉检测

Streaming Hallucination Detection in Long Chain-of-Thought Reasoning

Beijing University of Posts and Telecommunications(北京邮电大学);Nanyang Technological University(南洋理工大学);Southwest Jiaotong University(西南交通大学);Renmin University of China(中国人民大学)

Haolang Lu, Minghui Pan, Ripeng Li, Guoshun Nan, Jialin Zhuang, Zijie Zhao, Zhongxiang Sun, Kun Wang, Yang Liu

AI总结:

本研究提出通过跟踪推理状态演变来检测长推理链中的幻觉,提供实时可解释的检测证据。

摘要:

长推理链(CoT)推理提高了大语言模型的性能,但此类设置中幻觉往往以微妙的方式出现并传播到推理步骤中。我们提出幻觉在长CoT推理中应被视为一个演化的潜在状态,而非一次性的错误事件。因此,我们将步骤级别的幻觉判断视为局部观测,并引入一个累积前缀级幻觉信号,以跟踪整个轨迹中推理状态的全局演变。总体而言,我们的方法实现了对长CoT推理的流式幻觉检测,提供实时且可解释的证据。

英文摘要:

Long chain-of-thought (CoT) reasoning improves the performance of large language models, yet hallucinations in such settings often emerge subtly and propagate across reasoning steps. We suggest that hallucination in long CoT reasoning is better understood as an evolving latent state rather than a one-off erroneous event. Accordingly, we treat step-level hallucination judgments as local observations and introduce a cumulative prefix-level hallucination signal that tracks the global evolution of the reasoning state over the entire trajectory. Overall, our approach enables streaming hallucination detection in long CoT reasoning, providing real-time, interpretable evidence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑