arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.08271cs.HC
收藏

可解释AI提升人-AI协作中的任务绩效

Explainable AI improves task performance in human-AI collaboration

Julian Senoner, Simon Schallmoser, Bernhard Kratzwald, Stefan Feuerriegel, Torbjørn Netland

AI总结:

本文通过制造业与医学两项预注册视觉检查实验,证明可视化热力图形式的可解释AI相较黑箱AI能帮助专家正确遵从或推翻预测,并显著降低决策错误率。

摘要:

人工智能(AI)为辅助人类工作提供了大量机会。然而,人-AI协作的一个关键挑战在于,许多AI算法以黑箱方式运行,AI作出预测的方式仍然不透明。这使得人类难以依据自身的领域知识来验证AI作出的预测。因此,我们假设,以可解释AI作为决策辅助来增强人类能力,能够提升人-AI协作中的任务绩效。为检验这一假设,我们分析了以可视化热力图形式的可解释AI增强领域专家能力所产生的影响。随后,我们比较了两类参与者:一类由(a)黑箱AI提供支持,另一类由(b)可解释AI提供支持;后者能够帮助参与者在AI准确时遵从AI预测,或在AI预测错误时推翻AI。我们开展了两项预注册实验,采用来自制造业和医学的、具有代表性的真实世界视觉检查任务。第一项实验的参与者是一家电子工厂的工人,他们完成了N=9,600次关于电子产品是否存在缺陷的评估。第二项实验的参与者是放射科医生,他们完成了N=5,650次胸部X光图像评估,以识别肺部病变。我们针对执行真实世界任务的领域专家进行的实验结果表明,当参与者获得可解释AI而非黑箱AI支持时,任务绩效会提升。例如,在制造业场景中,我们发现以可解释AI(相对于黑箱AI)增强参与者能力,会使人类决策的中位错误率降低五倍,从而显著提升任务绩效。

英文摘要:

Artificial intelligence (AI) provides considerable opportunities to assist human work. However, one crucial challenge of human-AI collaboration is that many AI algorithms operate in a black-box manner where the way how the AI makes predictions remains opaque. This makes it difficult for humans to validate a prediction made by AI against their own domain knowledge. For this reason, we hypothesize that augmenting humans with explainable AI as a decision aid improves task performance in human-AI collaboration. To test this hypothesis, we analyze the effect of augmenting domain experts with explainable AI in the form of visual heatmaps. We then compare participants that were either supported by (a) black-box AI or (b) explainable AI, where the latter supports them to follow AI predictions when the AI is accurate or overrule the AI when the AI predictions are wrong. We conducted two preregistered experiments with representative, real-world visual inspection tasks from manufacturing and medicine. The first experiment was conducted with factory workers from an electronics factory, who performed $N=9,600$ assessments of whether electronic products have defects. The second experiment was conducted with radiologists, who performed $N=5,650$ assessments of chest X-ray images to identify lung lesions. The results of our experiments with domain experts performing real-world tasks show that task performance improves when participants are supported by explainable AI instead of black-box AI. For example, in the manufacturing setting, we find that augmenting participants with explainable AI (as opposed to black-box AI) leads to a five-fold decrease in the median error rate of human decisions, which gives a significant improvement in task performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑