arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.14130cs.AI
收藏

为何不两者兼得?用不确定性补充解释,以及自信在人机协作中的作用

Why not both? Complementing explanations with uncertainty, and the role of self-confidence in Human-AI collaboration

The University of Edinburgh(爱丁堡大学)

Ioannis Papantonis, Vaishak Belle

AI总结:

本研究针对高风险领域人机协作需求,通过实证研究探究不确定性估计与模型解释结合对用户依赖、理解及信任模型的影响,同时分析用户自信对行为的作用及对相关分析结果的扭曲效应。

摘要:

人工智能与机器学习模型已在医疗、刑事司法等关键领域得到诸多应用。然而,将这类高风险应用完全自动化可能引发伦理或公平问题。相反,在这类场景中,应由自动化系统为人类提供辅助,使双方通过互动达成联合决策。本研究开展了一项实证研究,旨在明确不确定性估计与模型解释如何影响用户对模型的依赖度、理解度与信任度,探究将二者结合的潜在益处。此外,我们还评估了用户对自身完成特定任务能力的自信程度如何影响其行为,同时讨论了这种自信可能如何扭曲基于一致性和切换百分比的分析结果。

英文摘要:

AI and ML models have already found many applications in critical domains, such as healthcare and criminal justice. However, fully automating such high-stakes applications can raise ethical or fairness concerns. Instead, in such cases, humans should be assisted by automated systems so that the two parties reach a joint decision, stemming out of their interaction. In this work we conduct an empirical study to identify how uncertainty estimates and model explanations affect users' reliance, understanding, and trust towards a model, looking for potential benefits of bringing the two together. Moreover, we seek to assess how users' behaviour is affected by their own self-confidence in their abilities to perform a certain task, while we also discuss how the latter may distort the outcome of an analysis based on agreement and switching percentages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑