arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2512.20182cs.CLcs.AI

FaithLens:检测并解释忠实性幻觉

FaithLens: Detecting and Explaining Faithfulness Hallucination

Tsinghua University(清华大学);DeepLang AI;Fudan University(复旦大学);University of Illinois Urbana-Champaign(伊利诺伊大学香槟分校);Peking University(北京大学)

Shuzheng Si, Qingyi Wang, Haozhe Zhao, Yuzhuo Bai, Guanqiao Chen, Kangyang Luo, Gang Chen, Fanchao Qi, Minjia Zhang, Baobao Chang, Maosong Sun

AI总结:

本文提出FaithLens模型,通过合成训练数据和规则强化学习,有效检测并解释大语言模型中的忠实性幻觉,优于GPT-5.2和o3模型,提升可信度与效率。

摘要:

识别大语言模型(LLM)输出中的忠实性幻觉对实际应用至关重要,例如检索增强生成和摘要。本文介绍FaithLens,一种成本高效且有效的忠实性幻觉检测模型,可同时提供二元预测和相应解释以提高可信度。为此,我们首先通过先进LLM合成带有解释的训练数据,并应用明确的数据过滤策略确保标签正确性、解释质量和数据多样性。随后,我们在这些精心整理的训练数据上微调模型作为冷启动,并进一步通过基于规则的强化学习优化,利用预测正确性和解释质量的奖励。在12种多样任务上的结果表明,8B参数的FaithLens优于GPT-5.2和o3等先进模型。此外,FaithLens能生成高质量的解释,实现可信度、效率和效果的平衡。

英文摘要:

Recognizing whether outputs from large language models (LLMs) contain faithfulness hallucination is crucial for real-world applications, e.g., retrieval-augmented generation and summarization. In this paper, we introduce FaithLens, a cost-efficient and effective faithfulness hallucination detection model that can jointly provide binary predictions and corresponding explanations to improve trustworthiness. To achieve this, we first synthesize training data with explanations via advanced LLMs and apply a well-defined data filtering strategy to ensure label correctness, explanation quality, and data diversity. Subsequently, we fine-tune the model on these well-curated training data as a cold start and further optimize it with rule-based reinforcement learning, using rewards for both prediction correctness and explanation quality. Results on 12 diverse tasks show that the 8B-parameter FaithLens outperforms advanced models such as GPT-5.2 and o3. Also, FaithLens can produce high-quality explanations, delivering a distinctive balance of trustworthiness, efficiency, and effectiveness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑