arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.01237cs.CLcs.AI

面向大语言模型可靠性增强的置信度感知路由:一种生成前幻觉缓解的多信号方法

Confidence-Aware Routing for Large Language Model Reliability Enhancement: A Multi-Signal Approach to Pre-Generation Hallucination Mitigation

AI Safety Research(人工智能安全研究);Convai Innovations(Convai创新)

Nandakishor M

AI总结:

针对大语言模型的幻觉问题,提出融合三类信号的置信度感知路由系统,生成前主动评估不确定性并分流查询,在知识密集型问答基准上显著提升幻觉检测效果与F1分数,同时降低计算成本。

摘要:

大语言模型(LLM)存在幻觉问题,会生成看似合理但事实错误的内容。当前的缓解策略主要聚焦于生成后校正,这类方法计算成本高昂,且无法阻止不可靠内容的生成。我们提出一种置信度感知路由系统,可在生成前主动评估模型的不确定性,并根据预估的可靠性重定向查询。\n该方法融合了三种互补的信号:内部表征与参考嵌入之间的语义对齐、跨模型层的内部收敛分析,以及习得的置信度估计。统一的置信度分数决定查询流向四条路径:高置信度走本地生成,中置信度走检索增强生成(RAG),低置信度调用更大模型,极低置信度则交由人工审核。\n在知识密集型问答基准上的评估显示,该方法的幻觉检测能力显著提升(基线为0.42,本方法达0.74),同时与事后方法相比计算成本降低40%。F1分数从0.61提升至0.82,且假阳性率较低(0.09)。这种从被动校正到主动评估的范式转变,为LLM可靠性增强提供了一种计算高效的方案。

英文摘要:

Large Language Models suffer from hallucination, generating plausible yet factually incorrect content. Current mitigation strategies focus on post-generation correction, which is computationally expensive and fails to prevent unreliable content generation. We propose a confidence-aware routing system that proactively assesses model uncertainty before generation and redirects queries based on estimated reliability. Our approach combines three complementary signals: semantic alignment between internal representations and reference embeddings, internal convergence analysis across model layers, and learned confidence estimation. The unified confidence score determines routing to four pathways: local generation for high confidence, retrieval-augmented generation for medium confidence, larger models for low confidence, and human review for very low confidence. Evaluation on knowledge-intensive QA benchmarks demonstrates significant improvements in hallucination detection (0.74 vs. 0.42 baseline) while reducing computational costs by 40% compared to post-hoc methods. The F1 score improves from 0.61 to 0.82 with low false positive rates (0.09). This paradigm shift from reactive correction to proactive assessment offers a computationally efficient approach to LLM reliability enhancement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑