arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2506.03399cs.HCcs.AI
收藏

采样偏好产生简单的可信度分数

Sampling Preferences Yields Simple Trustworthiness Scores

The MITRE Corporation(MITRE公司)

Sean Steinle

AI总结:

本文提出偏好采样方法,从LLM多维度评估结果中提取标量可信度分数,实验表明其归约性和对用户先验的敏感性均优于帕累托最优与分数平均法。

摘要:

随着大型语言模型(LLMs)的出现,人工智能(AI)模型的性能正变得日益多维度。相应地,已有多个大型、多维度的评估框架被提出用于评估LLMs。尽管这些框架比以往仅使用单一分数(如准确率)的尝试要现实得多,但多维度评估会使决策变得复杂,因为没有明显的方法来选择最优模型。本文引入了偏好采样(preference sampling),这是一种从多维度评估结果中提取标量可信度分数的方法,通过考虑用户所看重的模型性能的众多特征来实现。我们利用TrustLLM和DecodingTrust对LLMs的多维度可信度评估,展示了偏好采样优于其他聚合方法。我们发现,偏好采样始终具有归约性,在100%的情况下都能完全缩减候选模型集合,而帕累托最优(Pareto optimality)从未将集合缩减超过50%。同样,偏好采样始终对用户先验敏感——允许用户指定其偏好的相对权重和置信度——而分数平均法则对用户的先验知识不予响应。

英文摘要:

With the onset of large language models (LLMs), the performance of artificial intelligence (AI) models is becoming increasingly multi-dimensional. Accordingly, there have been several large, multi-dimensional evaluation frameworks put forward to evaluate LLMs. Though these frameworks are much more realistic than previous attempts which only used a single score like accuracy, multi-dimensional evaluations can complicate decision-making since there is no obvious way to select an optimal model. This work introduces preference sampling, a method to extract a scalar trustworthiness score from multi-dimensional evaluation results by considering the many characteristics of model performance which users value. We show that preference sampling improves upon alternate aggregation methods by using multi-dimensional trustworthiness evaluations of LLMs from TrustLLM and DecodingTrust. We find that preference sampling is consistently reductive, fully reducing the set of candidate models 100% of the time whereas Pareto optimality never reduces the set by more than 50%. Likewise, preference sampling is consistently sensitive to user priors-allowing users to specify the relative weighting and confidence of their preferences-whereas averaging scores is intransigent to the users' prior knowledge.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑