arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2509.22751stat.MLcs.AIcs.LG
收藏

无真值条件下以实体为中心的AI系统的方差有界评估:理论与测量

Variance-Bounded Evaluation of Entity-Centric AI Systems Without Ground Truth: Theory and Measurement

University of Pennsylvania(宾夕法尼亚大学)

Kaihua Ding

AI总结:

针对无真值标签场景下AI系统评估难题,提出VB-Score方差有界评估框架,通过约束松弛和Monte Carlo采样联合测量有效性与鲁棒性,揭示了传统方法隐藏的鲁棒性差异。

摘要:

当真值标签不可用时,AI系统的可靠评估仍是一个基本挑战,特别是对于生成自然语言输出的系统(如AI聊天和智能体系统)。许多AI智能体和系统专注于以实体为中心的任务。在企业环境中,组织部署AI系统用于实体链接、数据集成和信息检索,由于专有数据限制,针对黄金标准进行验证通常不可行。在针对具有模糊标准的专业数据集评估AI系统时,学术部署面临类似挑战。根植于监督学习范式的传统评估框架在无法定义单一正确答案的场景中失效。我们引入VB-Score,一种用于以实体为中心的AI系统的方差有界评估框架,通过联合测量有效性和鲁棒性在无真值条件下运行。给定系统输入,VB-Score通过约束松弛和Monte Carlo采样枚举合理解释,分配反映其似然性的概率。然后通过系统输出在解释中的预期成功来评估输出,并用方差进行惩罚以评估系统鲁棒性。我们提供形式化理论分析,确立包括范围、单调性和稳定性等关键性质,以及Monte Carlo估计的集中界限。通过对具有模糊输入的AI系统进行案例研究,我们证明VB-Score揭示了传统评估框架隐藏的鲁棒性差异,为评估标签稀缺领域的AI系统可靠性提供了有原则的测量框架。

英文摘要:

Reliable evaluation of AI systems remains a fundamental challenge when ground truth labels are unavailable, particularly for systems generating natural language outputs like AI chat and agent systems. Many of these AI agents and systems focus on entity-centric tasks. In enterprise contexts, organizations deploy AI systems for entity linking, data integration, and information retrieval where verification against gold standards is often infeasible due to proprietary data constraints. Academic deployments face similar challenges when evaluating AI systems on specialized datasets with ambiguous criteria. Conventional evaluation frameworks, rooted in supervised learning paradigms, fail in such scenarios where single correct answers cannot be defined. We introduce VB-Score, a variance-bounded evaluation framework for entity-centric AI systems that operates without ground truth by jointly measuring effectiveness and robustness. Given system inputs, VB-Score enumerates plausible interpretations through constraint relaxation and Monte Carlo sampling, assigning probabilities that reflect their likelihood. It then evaluates system outputs by their expected success across interpretations, penalized by variance to assess robustness of the system. We provide formal theoretical analysis establishing key properties including range, monotonicity, and stability along with concentration bounds for Monte Carlo estimation. Through case studies on AI systems with ambiguous inputs, we demonstrate that VB-Score reveals robustness differences hidden by conventional evaluation frameworks, offering a principled measurement framework for assessing AI system reliability in label-scarce domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑