arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.07938cs.HCcs.LG
收藏

决策快与慢:认知偏差在人工智能辅助决策中的作用

Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making

Carnegie Mellon University(卡内基梅隆大学);Twitter(推特);IBM Research(IBM研究院);Onfido

Charvi Rastogi, Yunfeng Zhang, Dennis Wei, Kush R. Varshney, Amit Dhurandhar, Richard Tomsett

摘要:

几项研究旨在弥合人工智能(AI)和人类决策者在AI辅助决策方面的差距,人类是AI模型预测的消费者,也是高风险应用程序的最终决策者。然而,人们的感知和理解往往被他们的认知偏差所扭曲,如确认偏差、锚定偏差、可用性偏差等。在这项工作中,我们使用认知科学领域的知识来解释人类-人工智能协作决策环境中的认知偏见,并减轻其对协作绩效的负面影响。为此,我们对认知偏差进行了数学建模,并提供了一个通用框架,通过该框架,研究人员和从业者可以了解认知偏差与人类-AI准确性之间的相互作用。然后,我们特别关注锚定偏差,这是人类与人工智能合作中常见的偏差。我们实施了一种基于时间的去锚策略,并进行了第一次用户实验,以验证其在人类-人工智能协作决策中的有效性。有了这个结果,我们为资源受限的环境设计了一个时间分配策略,在一些假设下实现了最佳的人类-AI协作。然后,我们进行了第二次用户实验,结果表明,我们的时间分配策略与解释可以有效地脱锚人类和提高协作性能时,人工智能模型具有低置信度,是不正确的。

英文摘要:

Several strands of research have aimed to bridge the gap between artificial intelligence (AI) and human decision-makers in AI-assisted decision-making, where humans are the consumers of AI model predictions and the ultimate decision-makers in high-stakes applications. However, people's perception and understanding are often distorted by their cognitive biases, such as confirmation bias, anchoring bias, availability bias, to name a few. In this work, we use knowledge from the field of cognitive science to account for cognitive biases in the human-AI collaborative decision-making setting, and mitigate their negative effects on collaborative performance. To this end, we mathematically model cognitive biases and provide a general framework through which researchers and practitioners can understand the interplay between cognitive biases and human-AI accuracy. We then focus specifically on anchoring bias, a bias commonly encountered in human-AI collaboration. We implement a time-based de-anchoring strategy and conduct our first user experiment that validates its effectiveness in human-AI collaborative decision-making. With this result, we design a time allocation strategy for a resource-constrained setting that achieves optimal human-AI collaboration under some assumptions. We, then, conduct a second user experiment which shows that our time allocation strategy with explanation can effectively de-anchor the human and improve collaborative performance when the AI model has low confidence and is incorrect.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑