arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2002.01543cs.HC
收藏

人机交互中的透明度和信任:模型不可知推理在基于计算机视觉的决策支持中的作用

Transparency and Trust in Human-AI-Interaction: The Role of Model-Agnostic Explanations in Computer Vision-Based Decision Support

Christian Meske, Enrico Bunde

摘要:

过去几年,计算机视觉以及基于人工智能的图像信息提取越来越受到关注,例如在医疗诊断领域。虽然算法的复杂性是其性能提高的一个原因,但它也导致了“黑匣子”问题,从而降低了对AI的信任。在这方面,“可解释的人工智能“(XAI)允许打开那个黑匣子,并提高AI的透明度。在本文中,我们首先讨论了可解释性对AI信任的理论影响,然后展示了XAI在健康相关环境中的使用情况。更具体地说,我们展示了XAI如何应用于理解为什么基于深度学习的计算机视觉在图像数据(薄血涂片幻灯片图像)上检测到或没有检测到疾病(疟疾)。此外,我们还研究了XAI如何用于比较计算机视觉中常用的两种不同深度学习模型的检测策略:卷积神经网络和多层感知器。我们的经验结果表明,i)人工智能有时使用图像的可疑或不相关的数据特征来检测疟疾(即使预测正确),ii)不同的深度学习模型解释相同预测的方式可能存在显着差异。我们的理论讨论强调了XAI可以支持计算机视觉系统和一般AI系统的信任,特别是通过增加可理解性和可预测性。

英文摘要:

Computer Vision, and hence Artificial Intelligence-based extraction of information from images, has increasingly received attention over the last years, for instance in medical diagnostics. While the algorithms' complexity is a reason for their increased performance, it also leads to the "black box" problem, consequently decreasing trust towards AI. In this regard, "Explainable Artificial Intelligence" (XAI) allows to open that black box and to improve the degree of AI transparency. In this paper, we first discuss the theoretical impact of explainability on trust towards AI, followed by showcasing how the usage of XAI in a health-related setting can look like. More specifically, we show how XAI can be applied to understand why Computer Vision, based on deep learning, did or did not detect a disease (malaria) on image data (thin blood smear slide images). Furthermore, we investigate, how XAI can be used to compare the detection strategy of two different deep learning models often used for Computer Vision: Convolutional Neural Network and Multi-Layer Perceptron. Our empirical results show that i) the AI sometimes used questionable or irrelevant data features of an image to detect malaria (even if correctly predicted), and ii) that there may be significant discrepancies in how different deep learning models explain the same prediction. Our theoretical discussion highlights that XAI can support trust in Computer Vision systems, and AI systems in general, especially through an increased understandability and predictability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑