我们应该相信(X)AI吗?结构化实验评价的设计尺寸
Should We Trust (X)AI? Design Dimensions for Structured Experimental Evaluations
摘要:
本文系统地推导了可解释人工智能(XAI)方法的结构化评价的设计维度。这些维度能够进行描述性表征,便于不同研究设计之间的比较。它们进一步构建了XAI的设计空间,并朝着XAI严格研究所需的精确术语汇聚。我们的文献综述区分了比较研究和应用论文,揭示了机器学习,人机交互和视觉分析领域之间的方法差异。通常,这些学科中的每一个都针对XAI过程的特定部分。弥合由此产生的差距,使XAI在现实世界的情况下,提出了我们的概念模型特征偏见来源和信任建设的整体评估。此外,我们确定和讨论的基础上观察到的研究差距,应导致更好地覆盖所提出的模型的未来工作的潜力。
英文摘要:
This paper systematically derives design dimensions for the structured evaluation of explainable artificial intelligence (XAI) approaches. These dimensions enable a descriptive characterization, facilitating comparisons between different study designs. They further structure the design space of XAI, converging towards a precise terminology required for a rigorous study of XAI. Our literature review differentiates between comparative studies and application papers, revealing methodological differences between the fields of machine learning, human-computer interaction, and visual analytics. Generally, each of these disciplines targets specific parts of the XAI process. Bridging the resulting gaps enables a holistic evaluation of XAI in real-world scenarios, as proposed by our conceptual model characterizing bias sources and trust-building. Furthermore, we identify and discuss the potential for future work based on observed research gaps that should lead to better coverage of the proposed model.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。