Trepan Expanded:一种解释人工神经网络的知识驱动方法
Trepan Reloaded: A Knowledge-driven Approach to Explaining Artificial Neural Networks
摘要:
人工智能中的可解释性已经重新成为一个积极研究的主题,因为需要在自动决策的“如何”和“为什么”方面向用户传达安全和信任。虽然已经开发了大量的方法事后可解释性,只有少数专注于如何使用领域知识,以及如何从用户的角度影响全球解释的可理解性。在本文中,我们展示了本体论如何帮助全球事后解释的可理解性,以符号模型的形式呈现。特别是,我们建立在环,解释人工神经网络的算法,通过决策树,我们将其扩展到包括本体建模领域知识的过程中产生的解释。我们提出了一个用户研究的结果,衡量的可理解性的决策树使用的语法复杂性的措施,并通过时间和准确性的反应,以及报告的用户信心和可理解性。用户研究考虑了解释至关重要的领域,即金融和医学领域。实验结果表明,与不使用本体的标准Trepan算法相比,该算法生成的决策树考虑了领域知识,具有更好的可理解性。
英文摘要:
Explainability in Artificial Intelligence has been revived as a topic of active research by the need of conveying safety and trust to users in the `how' and `why' of automated decision-making. Whilst a plethora of approaches have been developed for post-hoc explainability, only a few focus on how to use domain knowledge, and how this influences the understandability of global explanations from the users' perspective. In this paper, we show how ontologies help the understandability of global post-hoc explanations, presented in the form of symbolic models. In particular, we build on Trepan, an algorithm that explains artificial neural networks by means of decision trees, and we extend it to include ontologies modeling domain knowledge in the process of generating explanations. We present the results of a user study that measures the understandability of decision trees using a syntactic complexity measure, and through time and accuracy of responses as well as reported user confidence and understandability. The user study considers domains where explanations are critical, namely, in finance and medicine. The results show that decision trees generated with our algorithm, taking into account domain knowledge, are more understandable than those generated by standard Trepan without the use of ontologies.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。