arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.15514cs.AIcs.HCcs.LG
收藏

人类对基于人工智能的决策支持系统的反应:关于准确性和偏差影响的用户研究

Human Response to an AI-Based Decision Support System: A User Study on the Effects of Accuracy and Bias

University Pompeu Fabra(庞培法布拉大学);National Research Council(国家研究委员会);University of Pisa(比萨大学)

David Solans, Andrea Beretta, Manuel Portela, Carlos Castillo, Anna Monreale

摘要:

人工智能(AI)越来越多地用于在许多领域构建决策支持系统(DSS)。本文介绍了一系列的实验,旨在观察人类的反应不同的特征的DSS,如准确性和偏见,特别是在何种程度上参与者依赖的DSS,他们实现的性能。在我们的实验中,参与者玩一个简单的在线游戏,灵感来自所谓的“野猫”(即,勘探)钻探石油。景观有两层:描述成本(地形)的可见层和描述回报(石油产量)的隐藏层。对照组的参与者在没有任何帮助的情况下玩游戏,而在治疗组中,他们得到了DSS的帮助,DSS建议了钻孔的地方。对于某些处理,DSS不考虑成本,而只考虑奖励,这引入了用户可观察到的偏差。在受试者之间,我们改变DSS的准确性和偏差,并观察参与者的总分,完成时间,他们遵循或忽略建议的程度。我们亦会在离职调查中衡量直接资助计划的可接受程度。我们的研究结果表明,参与者往往得分更好的DSS,分数的增加是由于用户以下DSS的建议,并与游戏的难度和DSS的准确性。我们观察到,这种设置消除了参与者的大多数理性行为,他们对DSS有适度的信任,并且没有表现出算法厌恶(依赖不足)或自动化偏差(过度依赖)。然而,他们在离职调查中表示愿意接受决策支持系统,这似乎比他们的行为对决策支持系统的准确性不那么敏感,这表明用户仅仅部分地意识到DSS的准确性(缺乏准确性)。

英文摘要:

Artificial Intelligence (AI) is increasingly used to build Decision Support Systems (DSS) across many domains. This paper describes a series of experiments designed to observe human response to different characteristics of a DSS such as accuracy and bias, particularly the extent to which participants rely on the DSS, and the performance they achieve. In our experiments, participants play a simple online game inspired by so-called "wildcat" (i.e., exploratory) drilling for oil. The landscape has two layers: a visible layer describing the costs (terrain), and a hidden layer describing the reward (oil yield). Participants in the control group play the game without receiving any assistance, while in treatment groups they are assisted by a DSS suggesting places to drill. For certain treatments, the DSS does not consider costs, but only rewards, which introduces a bias that is observable by users. Between subjects, we vary the accuracy and bias of the DSS, and observe the participants' total score, time to completion, the extent to which they follow or ignore suggestions. We also measure the acceptability of the DSS in an exit survey. Our results show that participants tend to score better with the DSS, that the score increase is due to users following the DSS advice, and related to the difficulty of the game and the accuracy of the DSS. We observe that this setting elicits mostly rational behavior from participants, who place a moderate amount of trust in the DSS and show neither algorithmic aversion (under-reliance) nor automation bias (over-reliance).However, their stated willingness to accept the DSS in the exit survey seems less sensitive to the accuracy of the DSS than their behavior, suggesting that users are only partially aware of the (lack of) accuracy of the DSS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑