arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2009.06433cs.HCcs.AI
收藏

我们应该相信(X)AI吗?结构化实验评价的设计尺寸

Should We Trust (X)AI? Design Dimensions for Structured Experimental Evaluations

University of Konstanz(康斯坦茨大学);Georgia Institute of Technology(佐治亚理工学院)

Fabian Sperrle, Mennatallah El-Assady, Grace Guo, Duen Horng Chau, Alex Endert, Daniel Keim

摘要:

本文系统地推导了可解释人工智能(XAI)方法的结构化评价的设计维度。这些维度能够进行描述性表征,便于不同研究设计之间的比较。它们进一步构建了XAI的设计空间,并朝着XAI严格研究所需的精确术语汇聚。我们的文献综述区分了比较研究和应用论文,揭示了机器学习,人机交互和视觉分析领域之间的方法差异。通常,这些学科中的每一个都针对XAI过程的特定部分。弥合由此产生的差距,使XAI在现实世界的情况下,提出了我们的概念模型特征偏见来源和信任建设的整体评估。此外,我们确定和讨论的基础上观察到的研究差距,应导致更好地覆盖所提出的模型的未来工作的潜力。

英文摘要:

This paper systematically derives design dimensions for the structured evaluation of explainable artificial intelligence (XAI) approaches. These dimensions enable a descriptive characterization, facilitating comparisons between different study designs. They further structure the design space of XAI, converging towards a precise terminology required for a rigorous study of XAI. Our literature review differentiates between comparative studies and application papers, revealing methodological differences between the fields of machine learning, human-computer interaction, and visual analytics. Generally, each of these disciplines targets specific parts of the XAI process. Bridging the resulting gaps enables a holistic evaluation of XAI in real-world scenarios, as proposed by our conceptual model characterizing bias sources and trust-building. Furthermore, we identify and discuss the potential for future work based on observed research gaps that should lead to better coverage of the proposed model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑