arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.22070cs.AI
收藏

语言模型表现出对算法代理和人类专家的不一致偏见

Language Models Exhibit Inconsistent Biases Towards Algorithmic Agents and Human Experts

Computer Science University of Toronto(计算机科学大学 Toronto)

Jessica Y. Bo, Lillio Mok, Ashton Anderson

AI总结:

研究发现语言模型对人类专家和算法存在不一致偏见,需在高风险应用中谨慎对待。

摘要:

大型语言模型越来越多地用于需要处理多种信息源的决策任务,包括人类专家和其他算法代理。LLMs如何权衡这些不同来源提供的信息?我们考虑了已研究的算法厌恶现象,即人类决策者对算法预测存在偏见。借鉴行为经济学中的实验范式,我们评估了八个不同的LLMs在将委托人框架为人类专家或算法代理时如何委托决策任务。为了涵盖不同的评估格式,我们采用两种任务呈现方式:明确偏好,通过直接查询对任一代理的信任度进行建模;以及隐含偏好,通过提供上下文示例展示两种代理的性能。当被要求对人类专家和算法在多样化任务中的可信度进行评分时,LLMs对人类专家的评分更高,这与先前人类响应的结果相关。然而,当展示人类专家和算法的性能并要求在两者之间进行有激励的赌注时,LLMs倾向于选择算法,即使该算法表现明显更差。这些矛盾的结果表明,LLMs可能编码了对人类和算法不一致的偏见,这在高风险场景中需要仔细考虑。此外,我们讨论了LLMs对任务呈现格式的敏感性,这种敏感性应广泛在AI安全评估鲁棒性中受到审视。

英文摘要:

Large language models are increasingly used in decision-making tasks that require them to process information from a variety of sources, including both human experts and other algorithmic agents. How do LLMs weigh the information provided by these different sources? We consider the well-studied phenomenon of algorithm aversion, in which human decision-makers exhibit bias against predictions from algorithms. Drawing upon experimental paradigms from behavioural economics, we evaluate how eightdifferent LLMs delegate decision-making tasks when the delegatee is framed as a human expert or an algorithmic agent. To be inclusive of different evaluation formats, we conduct our study with two task presentations: stated preferences, modeled through direct queries about trust towards either agent, and revealed preferences, modeled through providing in-context examples of the performance of both agents. When prompted to rate the trustworthiness of human experts and algorithms across diverse tasks, LLMs give higher ratings to the human expert, which correlates with prior results from human respondents. However, when shown the performance of a human expert and an algorithm and asked to place an incentivized bet between the two, LLMs disproportionately choose the algorithm, even when it performs demonstrably worse. These discrepant results suggest that LLMs may encode inconsistent biases towards humans and algorithms, which need to be carefully considered when they are deployed in high-stakes scenarios. Furthermore, we discuss the sensitivity of LLMs to task presentation formats that should be broadly scrutinized in evaluation robustness for AI safety.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑