arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2204.06916cs.HCcs.AI
收藏

我应该遵循基于AI的建议吗?测量人类-人工智能决策中的适当依赖性

Should I Follow AI-based Advice? Measuring Appropriate Reliance in Human-AI Decision-Making

Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院)

Max Schemmer, Patrick Hemmer, Niklas Kühl, Carina Benz, Gerhard Satzger

摘要:

日常生活中的许多重要决定都是在顾问的帮助下做出的,例如,关于医疗或金融投资的决定。过去,人们经常从人类专家、朋友或家人那里收到建议,而如今,基于人工智能(AI)的顾问变得越来越多。通常情况下,人工智能生成的建议由人类判断,要么被认为是可靠的,要么被拒绝。然而,最近的研究表明,人工智能的建议并不总是有益的,因为人类已经证明无法忽视不正确的人工智能建议,基本上代表了对人工智能的过度依赖。因此,我们的目标应该是让人类不要盲目地依赖人工智能的建议,而是区分其质量,并根据其做出更好的决策。具体来说,这意味着人类应该在正确建议的情况下依靠人工智能,而在遇到不正确的建议时依靠自己,即,在个案基础上建立对AI建议的适当依赖(AR)。目前的研究缺乏对AR的度量。这阻碍了对影响AR的因素进行严格的评估,并阻碍了人工智能决策的进一步发展。因此,在文献的基础上,我们推导出了AR的度量概念。我们建议将AR视为一个二维结构,衡量区分建议质量和相应行为的能力。在这篇文章中,我们推导出测量的概念,说明其应用和概述潜在的未来研究。

英文摘要:

Many important decisions in daily life are made with the help of advisors, e.g., decisions about medical treatments or financial investments. Whereas in the past, advice has often been received from human experts, friends, or family, advisors based on artificial intelligence (AI) have become more and more present nowadays. Typically, the advice generated by AI is judged by a human and either deemed reliable or rejected. However, recent work has shown that AI advice is not always beneficial, as humans have shown to be unable to ignore incorrect AI advice, essentially representing an over-reliance on AI. Therefore, the aspired goal should be to enable humans not to rely on AI advice blindly but rather to distinguish its quality and act upon it to make better decisions. Specifically, that means that humans should rely on the AI in the presence of correct advice and self-rely when confronted with incorrect advice, i.e., establish appropriate reliance (AR) on AI advice on a case-by-case basis. Current research lacks a metric for AR. This prevents a rigorous evaluation of factors impacting AR and hinders further development of human-AI decision-making. Therefore, based on the literature, we derive a measurement concept of AR. We propose to view AR as a two-dimensional construct that measures the ability to discriminate advice quality and behave accordingly. In this article, we derive the measurement concept, illustrate its application and outline potential future research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑