arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.07255cs.CLcs.AI
收藏

自然语言生成中的标签置信度感知不确定性估计

Label-Confidence-Aware Uncertainty Estimation in Natural Language Generation

Beijing University of Posts and Telecommunications(北京邮电大学);QuanCheng Laboratory(泉城实验室)

Qinhong Lin, Yinglun Feng, Yuhao Zhang, Zhongliang Yang, Linna Zhou

AI总结:

本文提出标签置信度感知不确定性量化(LCA-UQ)方法,基于逐点KL散度弥合全局熵与候选答案局部置信度之间的差距,在多种LLMs和NLP数据集上验证了其提升不确定性估计可靠性与稳定性的有效性。

摘要:

大型语言模型(LLMs)在生成任务中展现出卓越的能力,但由于其倾向于生成幻觉性响应,也带来了潜在风险。因此,不确定性量化(UQ)旨在区分答案的有效性,对于确保AI系统的安全性和鲁棒性至关重要。然而,现有方法主要依赖于测量多个随机样本的熵来表示不确定性,往往忽略了与被评估候选答案相关的特定不确定性信息。这种忽视可能导致有偏的分类结果。在本文中,我们研究了多个样本的全局熵与候选答案的局部置信度之间的差异,并提出了一种基于逐点Kullback-Leibler(PKL)散度的标签置信度感知不确定性量化(LCA-UQ)方法。我们的方法有效地弥合了采样输出的一致性与候选答案的校准之间的差距,从而增强了不确定性评估的可靠性和稳定性。在多种流行的LLMs和NLP数据集上的实证评估表明,标签来源显著影响分类结果。此外,我们的方法有效地捕捉了采样结果与标签来源之间的细微差别,在不确定性估计中展现出优越的性能。

英文摘要:

Large Language Models (LLMs) demonstrate remarkable capabilities in generative tasks but pose potential risks due to their tendency to generate hallucinatory responses. Therefore, Uncertainty Quantification (UQ), which aims to distinguish the validity of answers, is crucial for ensuring the safety and robustness of AI systems. However, existing methods primarily rely on measuring the entropy of multiple stochastic samples to represent uncertainty, often overlooking the specific uncertainty information associated with the candidate answer under evaluation. This oversight can lead to biased classification outcomes. In this paper, we investigate the discrepancy between global entropy from multiple samples and local confidence of candidate answer, and propose a Label-Confidence-Aware Uncertainty Quantification (LCA-UQ) method based on Pointwise Kullback-Leibler (PKL) divergence. Our method effectively bridges the gap between the consistency of sampled outputs and the calibration of the candidate answer, thereby enhancing the reliability and stability of uncertainty assessments. Empirical evaluations across a range of popular LLMs and NLP datasets reveal that label sources significantly impact classification. Furthermore, our approach effectively captures the nuances between sampling results and label sources, demonstrating superior performance in uncertainty estimation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑