校正人类标签中的评分者效应以改进AI评估:一项项目反应理论方法
Correcting Human Labels for Rater Effects in AI Evaluation: An Item Response Theory Approach
AI总结:
本文提出利用项目反应理论方法校正人类评分中的评分者效应,以提高AI评估的可靠性和有效性。
摘要:
人类评估在训练和评估AI模型中起着核心作用,但这些数据很少被视为受系统误差影响的测量数据。本文将心理计量评分模型整合到AI流程中,以提高从人类判断中得出的结论的可靠性和有效性。本文回顾了常见的评分者效应,即严重性和中心性,这些效应会扭曲观察到的评分,并展示了如何使用项目反应理论评分模型,特别是多维 Rasch 模型,将真实的输出质量与评分者行为分开。以 OpenAI 摘要数据集为例,我们展示了如何通过调整评分者严重性来产生校正的摘要质量估计,并提供评分者表现的诊断见解。将心理计量建模整合到人工参与的评估中,使人类数据的使用更加原则性且透明,使开发者能够基于调整后的分数而非原始、易出错的评分做出决策。这种观点强调了一条通往更稳健、可解释和与构念一致的AI开发和评估实践的道路。
英文摘要:
Human evaluations play a central role in training and assessing AI models, yet these data are rarely treated as measurements subject to systematic error. This paper integrates psychometric rater models into the AI pipeline to improve the reliability and validity of conclusions drawn from human judgments. The paper reviews common rater effects, severity and centrality, that distort observed ratings, and demonstrates how item response theory rater models, particularly the multi-faceted Rasch model, can separate true output quality from rater behavior. Using the OpenAI summarization dataset as an empirical example, we show how adjusting for rater severity produces corrected estimates of summary quality and provides diagnostic insight into rater performance. Incorporating psychometric modeling into human-in-the-loop evaluation offers more principled and transparent use of human data, enabling developers to make decisions based on adjusted scores rather than raw, error-prone ratings. This perspective highlights a path toward more robust, interpretable, and construct-aligned practices for AI development and evaluation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。