arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2508.01862cs.CLcs.AI

反事实探测:大型语言模型中幻觉的检测与缓解

Counterfactual Probing for Hallucination Detection and Mitigation in Large Language Models

Shihezi University(石河子大学)

Yijun Feng

AI总结:

提出反事实探测方法,通过生成含微妙错误的反事实陈述评估模型敏感性,以检测并缓解大型语言模型幻觉,无需重训,平均降低幻觉分数24.5%。

摘要:

大型语言模型在各类任务中展现出卓越的能力,然而它们经常生成流畅但事实错误或缺乏依据的幻觉输出。我们提出反事实探测,一种用于检测和缓解大型语言模型输出中幻觉的新方法。我们的方法动态生成看似合理但包含微妙事实错误的反事实陈述,然后评估模型对这些扰动的敏感性。我们假设,真正的知识对反事实变化具有鲁棒性,而幻觉内容在面对看似合理的替代方案时表现出不一致的置信度模式。我们在TruthfulQA、事实陈述数据集和精选的幻觉示例上进行的全面评估表明,与基线方法相比,反事实探测实现了更优的检测性能,同时我们的自适应缓解策略平均将幻觉分数降低了24.5%。该方法无需重新训练模型,可作为实时验证机制集成到现有的大型语言模型流程中。

英文摘要:

Large Language Models have demonstrated remarkable capabilities across diverse tasks, yet they frequently generate hallucinations outputs that are fluent but factually incorrect or unsupported. We propose Counterfactual Probing, a novel approach for detecting and mitigating hallucinations in LLM outputs. Our method dynamically generates counterfactual statements that appear plausible but contain subtle factual errors, then evaluates the model's sensitivity to these perturbations. We hypothesize that genuine knowledge exhibits robustness to counterfactual variations, while hallucinated content shows inconsistent confidence patterns when confronted with plausible alternatives. Our comprehensive evaluation on TruthfulQA, factual statement datasets, and curated hallucination examples demonstrates that counterfactual probing achieves superior detection performance compared to baseline methods, while our adaptive mitigation strategies reduce hallucination scores by an average of 24.5%. The approach requires no model retraining and can be integrated into existing LLM pipelines as a realtime verification mechanism.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑