Current deep learning models are not designed to simultaneously address three fundamental questions: predict class labels to solve a given classification task (the "What?"), simulate changes in the situation to evaluate how this impacts class predictions (the "How?"), and imagine how the scenario should change to result in different class predictions (the "Why not?"). The inability to answer these questions represents a crucial gap in deploying reliable AI agents, calibrating human trust, and improving human-machine interaction. To bridge this gap, we introduce CounterFactual Concept Bottleneck Models (CF-CBMs), a class of models designed to efficiently address the above queries all at once without the need to run post-hoc searches. Our experimental results demonstrate that CF-CBMs: achieve classification accuracy comparable to black-box models and existing CBMs ("What?"), rely on fewer important concepts leading to simpler explanations ("How?"), and produce interpretable, concept-based counterfactuals ("Why not?"). Additionally, we show that training the counterfactual generator jointly with the CBM leads to two key improvements: (i) it alters the model's decision-making process, making the model rely on fewer important concepts (leading to simpler explanations), and (ii) it significantly increases the causal effect of concept interventions on class predictions, making the model more responsive to these changes.
Beyond the Shadows of Plato's Cave: Evaluating False Memory in Autonomous Agents via Counterfactual Reasoning
Sydney AI Centre, The University of Sydney(悉尼大学悉尼人工智能中心);Australian Institute for Machine Learning, Adelaide University(阿德莱德大学澳大利亚机器学习研究所);Australian Artificial Intelligence Institute, University of Technology Sydney(悉尼科技大学澳大利亚人工智能研究所);Wuhan University(武汉大学);School of Mathematics and Statistics, The University of Melbourne(墨尔本大学数学与统计学院)
Counterfactual Supervision-based Information Bottleneck for Out-of-Distribution Generalization
South China University of Technology(华南理工大学)
学习不变(因果)特征的分布外(OOD)推广最近引起了广泛的关注,其中不变风险最小化(VRM)是一个值得注意的解决方案。尽管线性回归理论上有希望,但在线性分类问题中使用递归的挑战仍然存在。通过将信息瓶颈(IB)原理引入到机器学习中,IB-SVM方法已经证明了它解决这些挑战的能力。本文从两个方面进一步改进了IB-SVM。首先,我们证明了在IB-EQUIPMENT中使用的不变特征的支持重叠的关键假设对于保证OOD泛化是强有力的,并且在没有这个假设的情况下仍然有可能实现最优解。其次,我们说明了两种故障模式,IB-ESTA(和ESTA)可能会失败的学习不变的功能,并解决这样的故障,我们提出了一个\textit{Counterfactual Supervision-based Information Bottleneck (CSIB)}学习算法,可证明恢复不变的功能。通过要求反事实推理,CSIB即使在从单个环境访问数据时也能工作。在多个数据集上的实验验证了我们的理论结果。
Towards A Unified Information Bottleneck Framework for Time Series Explanations
Florida International University(佛罗里达国际大学);Carnegie Mellon University(卡内基梅隆大学);University of Houston(休斯顿大学);NEC Labs America(美国 NEC 实验室);Singapore Management University(新加坡管理大学)
Generating Counterfactual Trajectories with Latent Diffusion Models for Concept Discovery
Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau(莱茵兰-普法尔茨州 Kaiserslautern-Landau 技术大学);German Research Center for Artificial Intelligence GmbH (DFKI)(德国人工智能研究中心 GmbH(DFKI))
University of Copenhagen(哥本哈根大学);University of Cambridge(剑桥大学);University of Amsterdam(阿姆斯特丹大学);University of California, Berkeley(加州大学伯克利分校);University of Tokyo(东京大学);University of Washington(华盛顿大学);University of Oxford(牛津大学)
TU Darmstadt(达姆施塔特工业大学);Hessian Center for Artificial Intelligence (hessian.AI)(黑森人工智能中心);Centre for Cognitive Science, TU Darmstadt(达姆施塔特工业大学认知科学中心);German Center for Artificial Intelligence (DFKI)(德国人工智能研究中心)
Università della Svizzera Italiana(瑞士意大利大学);University of Liechtenstein(利赫泰森大学);Politecnico di Torino(托尼诺理工学院);IBM Research(IBM研究院);Scuola Universitaria Professionale della Svizzera Italiana(瑞士意大利专业大学)
From What Ifs to Insights: Counterfactuals in Causal Inference vs. Explainable AI
Institute of Service Science, National Tsing Hua University(服务科学研究所,国立清华大学);Faculty of Business and Economics, University of Antwerp(商学院与经济学院,安特卫普大学);Copenhagen Business School(哥本哈根商学院)
Provable Responsible AI and Data Analytics (PRADA) Lab(可证明的负责任AI与数据分析(PRADA)实验室);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);Shanghai Jiao Tong University(上海交通大学);The University of Auckland(奥克兰大学);RIKEN Center for Advanced Intelligence Project (AIP)(理化学研究所先进智能项目中心(AIP));Arizona State University(亚利桑那州立大学);Stony Brook University(石溪大学)