In the last years, XAI research has mainly been concerned with developing new technical approaches to explain deep learning models. Just recent research has started to acknowledge the need to tailor explanations to different contexts and requirements of stakeholders. Explanations must not only suit developers of models, but also domain experts as well as end users. Thus, in order to satisfy different stakeholders, explanation methods need to be combined. While multi-modal explanations have been used to make model predictions more transparent, less research has focused on treating explanation as a process, where users can ask for information according to the level of understanding gained at a certain point in time. Consequently, an opportunity to explore explanations on different levels of abstraction should be provided besides multi-modal explanations. We present a process-based approach that combines multi-level and multi-modal explanations. The user can ask for textual explanations or visualizations through conversational interaction in a drill-down manner. We use Inductive Logic Programming, an interpretable machine learning approach, to learn a comprehensible model. Further, we present an algorithm that creates an explanatory tree for each example for which a classifier decision is to be explained. The explanatory tree can be navigated by the user to get answers of different levels of detail. We provide a proof-of-concept implementation for concepts induced from a semantic net about living beings.
Directive Explanations for Monitoring the Risk of Diabetes Onset: Introducing Directive Data-Centric Explanations and Combinations to Support What-If Explorations
TalkToAgent: A Human-centric Explanation of Reinforcement Learning Agents with Large Language Models
Department of Chemical and Biological Engineering, Seoul National University, Republic of Korea(化学与生物工程系,首尔国立大学);Davidson School of Chemical Engineering, Purdue University, United States(化学工程大卫森学院,普渡大学)
From Multi-modal Property Dataset to Robot-centric Conceptual Knowledge About Household Objects
Otto-von-Guericke University Magdeburg(马格德堡奥托·冯·格里克大学);Jacobs University(雅各布大学);Technische Universität Bergakademie Freiberg(弗赖贝格工业大学);OFFIS Institute for Information Technology(奥弗斯信息技术研究所)
Benchmarking Instance-Centric Counterfactual Algorithms for XAI: From White Box to Black Box
Human Technology Institute, University of Technology Sydney(悉尼科技大学人类技术研究所);School of Information Systems, Queensland University of Technology(昆士兰科技大学信息系统学院);INESC-ID Lisboa / Instituto Superior Técnico, ULisboa(INESC-ID里斯本/里斯本大学高等技术学院)
E-CaTCH: Event-Centric Cross-Modal Attention with Temporal Consistency and Class-Imbalance Handling for Misinformation Detection
Department of Mathematics and Statistics, American University, Washington, DC, USA(数学与统计学系,美国大学,华盛顿特区,美国);Department of Computer Science and Mathematics, Pennsylvania State University, Harrisburg, PA, USA(计算机科学与数学系,宾夕法尼亚州立大学,哈里斯堡,宾夕法尼亚州,美国);Department of Computer Science, American University, Washington, DC, USA(计算机科学系,美国大学,华盛顿特区,美国)
Can Requirements Engineering Support Explainable Artificial Intelligence? Towards a User-Centric Approach for Explainability Requirements
Institute of Software Engineering University of Stuttgart Stuttgart, Germany Email;Institute of Software Engineering University of Stuttgart Stuttgart, Germany
CACARA: Cross-Modal Alignment Leveraging a Text-Centric Approach for Cost-Effective Multimodal and Multilingual Learning
Instituto de Computação, Universidade Estadual de Campinas (UNICAMP), Brasil(计算机学院,Campinas州立大学(UNICAMP));Instituto de Estudos da Linguagem, Universidade Estadual de Campinas (UNICAMP), Brasil(语言研究学院,Campinas州立大学(UNICAMP));Instituto de Informática, Universidade Federal de Goiás (UFG), Goiás, Brasil(信息学院,戈亚斯联邦大学(UFG));Department of Computer Science, University of Sheffield, Sheffield, United Kingdom(计算机科学系,谢菲尔德大学)
Learnable Game-theoretic Policy Optimization for Data-centric Self-explanation Rationalization
School of Computer and Information Technology, Shanxi University(山西大学计算机与信息学院);School of Computer and Information Systems, Singapore Management University(新加坡管理学院计算机与信息学院);Institute for Infocomm Research, A*Star(A*Star信息与通信研究所)
Heterogeneous Graph Neural Networks with Post-hoc Explanations for Multi-modal and Explainable Land Use Inference
Imperial College London, Department of Civil and Environmental Engineering(帝国理工学院伦敦校区土木与环境工程系);Imperial College London, Department of Computing(帝国理工学院伦敦校区计算机系)
FOCA: Frequency-Oriented Cross-Domain Forgery Detection, Localization and Explanation via Multi-Modal Large Language Model
Harbin Institute of Technology(哈尔滨工业大学);DZ-Matrix;Guangdong Laboratory of Artificial Intelligence and Digital Economy(广东省人工智能与数字经济实验室);Chongqing Research Institute of HIT(哈尔滨工业大学重庆研究院);University of New South Wales(新南威尔士大学)