测量大语言模型中的随机不确定性与认知不确定性:在分布内与分布外问答任务上的实证评估
Measuring Aleatoric and Epistemic Uncertainty in LLMs: Empirical Evaluation on ID and OOD QA Tasks
AI总结:
本文通过十二种UE方法和四种生成质量指标,在分布内与分布外问答任务上实证评估大语言模型的不确定性估计,发现基于信息的方法在ID场景更优,而基于密度的方法和P(True)指标在OOD场景更能捕捉认知不确定性。
摘要:
大语言模型(LLMs)已日益普及,在众多行业和学科中得到应用。确保LLM输出的可信度至关重要,其中不确定性估计(UE)发挥着关键作用。本文开展了一项全面的实证研究,考察多种UE方法在衡量LLM中随机不确定性和认知不确定性方面的鲁棒性与有效性。研究涉及十二种不同的UE方法以及四种生成质量指标,包括来自LLM批评器的LLMScore,用于在分布内(ID)和分布外(OOD)数据集上的问答(QA)任务中评估LLM生成答案的不确定性。我们的分析表明,基于信息的方法利用词元概率和序列概率,在ID场景下表现尤为出色,因为它们与模型对数据的理解相一致。相反,基于密度的方法和P(True)指标在OOD场景下表现出更优越的性能,凸显了它们在捕捉模型认知不确定性方面的有效性。语义一致性方法通过评估生成答案的变异性,在不同数据集和生成指标上均表现出可靠的性能。这些方法总体表现良好,但未必在每种情况下都是最优的。
英文摘要:
Large Language Models (LLMs) have become increasingly pervasive, finding applications across many industries and disciplines. Ensuring the trustworthiness of LLM outputs is paramount, where Uncertainty Estimation (UE) plays a key role. In this work, a comprehensive empirical study is conducted to examine the robustness and effectiveness of diverse UE measures regarding aleatoric and epistemic uncertainty in LLMs. It involves twelve different UE methods and four generation quality metrics including LLMScore from LLM criticizers to evaluate the uncertainty of LLM-generated answers in Question-Answering (QA) tasks on both in-distribution (ID) and out-of-distribution (OOD) datasets. Our analysis reveals that information-based methods, which leverage token and sequence probabilities, perform exceptionally well in ID settings due to their alignment with the model's understanding of the data. Conversely, density-based methods and the P(True) metric exhibit superior performance in OOD contexts, highlighting their effectiveness in capturing the model's epistemic uncertainty. Semantic consistency methods, which assess variability in generated answers, show reliable performance across different datasets and generation metrics. These methods generally perform well but may not be optimal for every situation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。