arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.07487cs.AIcs.CY
收藏

人工智能中信任的形式化:AI中人类信任的前提、原因和目标

Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI

Bar Ilan University(巴伊兰大学);Allen Institute for Artificial Intelligence(艾伦人工智能研究所);University of Washington(华盛顿大学);The University of Melbourne(墨尔本大学)

Alon Jacovi, Ana Marasović, Tim Miller, Yoav Goldberg

摘要:

信任是人与人工智能之间交互的核心组成部分,因为“不正确”的信任水平可能会导致技术的误用,滥用或停用。但是,准确地说,对人工智能的信任的本质是什么?信任的认知机制的前提和目标是什么?我们如何促进它们,或者评估它们在特定的互动中是否得到满足?本文旨在回答这些问题。我们讨论的信任模型的灵感,但不完全相同,社会学的人际信任(即,人与人之间的信任)。该模型依赖于两个关键属性,即用户的脆弱性和预测AI模型决策影响的能力。我们纳入了“合同信任”的形式化,这样用户和AI之间的信任就是一些隐性或显性合同将持有的信任,以及“可信度”的形式化(这与社会学中的可信度概念分离),以及“有保证”和“无保证”信任的概念。然后,我们提出了内在推理和外在行为的可能原因,并讨论了如何设计值得信赖的人工智能,如何评估信任是否已经表现出来,以及它是否是有道理的。最后,我们阐明信任和XAI之间的联系,使用我们的形式化。

英文摘要:

Trust is a central component of the interaction between people and AI, in that 'incorrect' levels of trust may cause misuse, abuse or disuse of the technology. But what, precisely, is the nature of trust in AI? What are the prerequisites and goals of the cognitive mechanism of trust, and how can we promote them, or assess whether they are being satisfied in a given interaction? This work aims to answer these questions. We discuss a model of trust inspired by, but not identical to, sociology's interpersonal trust (i.e., trust between people). This model rests on two key properties of the vulnerability of the user and the ability to anticipate the impact of the AI model's decisions. We incorporate a formalization of 'contractual trust', such that trust between a user and an AI is trust that some implicit or explicit contract will hold, and a formalization of 'trustworthiness' (which detaches from the notion of trustworthiness in sociology), and with it concepts of 'warranted' and 'unwarranted' trust. We then present the possible causes of warranted trust as intrinsic reasoning and extrinsic behavior, and discuss how to design trustworthy AI, how to evaluate whether trust has manifested, and whether it is warranted. Finally, we elucidate the connection between trust and XAI using our formalization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑