arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.16039cs.AI
收藏

评分的不确定性有多大?基于大语言模型的自动评估中不确定性度量的基准测试

How Uncertain Is the Grade? A Benchmark of Uncertainty Metrics for LLM-Based Automatic Assessment

Michigan State University(密歇根州立大学);University of Southern California(南加州大学);Washington State University(华盛顿州立大学)

Hang Li, Kaiqi Yang, Xianxuan Long, Fedor Filippov, Yucheng Chu, Yasemin Copur-Gencturk, Peng He, Cory Miller, Namsoo Shin, Joseph Krajcik, Hui Liu, Jiliang Tang

AI总结:

本文研究了基于大语言模型的自动评估中不确定性度量的基准测试,分析了不同方法的优劣及影响因素,旨在提升评分系统的可靠性。

摘要:

大语言模型(LLMs)的迅速发展正在重塑教育中的自动评估领域。尽管这些系统在适应不同问题类型和输出格式的灵活性方面具有显著优势,但它们也引入了新的挑战,即输出不确定性,这源于LLMs本质上概率性质。输出不确定性是自动评估中不可避免的挑战,因为评估结果往往在后续教学行动中起着关键作用,例如向学生提供建议或指导教学决策。不可靠或校准不佳的不确定性估计可能导致下游干预不稳定,可能干扰学生的学习过程并导致意外的负面后果。为了系统地理解这一挑战并指导未来研究,我们在此背景下对一系列不确定性量化方法进行了基准测试。尽管这些方法在其他领域的许多任务中已被证明有效,但它们在教育环境中的适用性和可靠性,特别是在自动评分方面,仍缺乏深入研究。通过全面分析多个评估数据集、LLM家族和生成控制设置中的不确定性行为,我们描述了LLMs在评分场景中表现出的不确定性模式。基于这些发现,我们评估了不同不确定性度量的优势和局限性,并分析了关键因素,包括模型家族、评估任务和解码策略,对不确定性估计的影响。我们的研究为LLM自动评估中的不确定性特性提供了可操作的见解,并为未来开发更可靠和有效的不确定性感知评分系统奠定了基础。

英文摘要:

The rapid rise of large language models (LLMs) is reshaping the landscape of automatic assessment in education. While these systems demonstrate substantial advantages in adaptability to diverse question types and flexibility in output formats, they also introduce new challenges related to output uncertainty, stemming from the inherently probabilistic nature of LLMs. Output uncertainty is an inescapable challenge in automatic assessment, as assessment results often play a critical role in informing subsequent pedagogical actions, such as providing feedback to students or guiding instructional decisions. Unreliable or poorly calibrated uncertainty estimates can lead to unstable downstream interventions, potentially disrupting students' learning processes and resulting in unintended negative consequences. To systematically understand this challenge and inform future research, we benchmark a broad range of uncertainty quantification methods in the context of LLM-based automatic assessment. Although the effectiveness of these methods has been demonstrated in many tasks across other domains, their applicability and reliability in educational settings, particularly for automatic grading, remain underexplored. Through comprehensive analyses of uncertainty behaviors across multiple assessment datasets, LLM families, and generation control settings, we characterize the uncertainty patterns exhibited by LLMs in grading scenarios. Based on these findings, we evaluate the strengths and limitations of different uncertainty metrics and analyze the influence of key factors, including model families, assessment tasks, and decoding strategies, on uncertainty estimates. Our study provides actionable insights into the characteristics of uncertainty in LLM-based automatic assessment and lays the groundwork for developing more reliable and effective uncertainty-aware grading systems in the future.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑