Causal models bring many benefits to decision-making systems (or agents) by making them interpretable, sample-efficient, and robust to changes in the input distribution. However, spurious correlations can lead to wrong causal models and predictions. We consider the problem of inferring a causal model of a reinforcement learning environment and we propose a method to deal with spurious correlations. Specifically, our method designs a reward function that incentivizes an agent to do an intervention to find errors in the causal model. The data obtained from doing the intervention is used to improve the causal model. We propose several intervention design methods and compare them. The experimental results in a grid-world environment show that our approach leads to better causal models compared to baselines: learning the model on data from a random policy or a policy trained on the environment's reward. The main contribution consists of methods to design interventions to resolve spurious correlations.
Sparse Causal Discovery with Generative Intervention for Unsupervised Graph Domain Adaptation
State Key Laboratory for Multimedia Information Processing, School of Computer Science, PKU-Anker LLM Lab（多媒体信息处理国家重点实验室，计算机科学学院，PKU-Anker LLM实验室）；Peking University（北京大学）；University of California, Los Angeles（加州大学洛杉矶分校）；Paul G. Allen School of Computer Science（保罗·G·艾伦计算机科学学院）；University of Washington（华盛顿大学）；Hong Kong University of Science and Technology（香港科技大学）
Spurious correlations are a threat to the trustworthiness of natural language processing systems, motivating research into methods for identifying and eliminating them. However, addressing the problem of spurious correlations requires more clarity on what they are and how they arise in language data. Gardner et al (2021) argue that the compositional nature of language implies that \emph{all} correlations between labels and individual "input features" are spurious. This paper analyzes this proposal in the context of a toy example, demonstrating three distinct conditions that can give rise to fe…
University of California, Santa Barbara（加州大学圣巴巴拉分校）
Although deep learning models have driven state-of-the-art performance on a wide array of tasks, they are prone to spurious correlations that should not be learned as predictive clues. To mitigate this problem, we propose a causality-based training framework to reduce the spurious correlations caused by observed confounders. We give theoretical analysis on the underlying general Structural Causal Model (SCM) and propose to perform Maximum Likelihood Estimation (MLE) on the interventional distribution instead of the observational distribution, namely Counterfactual Maximum Likelihood Estimation…
Deconfounded Reasoning for Multimodal Fake News Detection via Causal Intervention
Beihang University（北京航空航天大学）；School of Mathematics, Sun Yat-sen University（中山大学数学学院）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；Beijing National Research Center for Information Science and Technology, Tsinghua University（清华大学北京信息科学与技术国家研究中心）；Tencent AI Lab（腾讯AI Lab）
CausalGaze: Unveiling Hallucinations via Counterfactual Graph Intervention in Large Language Models
College of Electronic Engineering, National University of Defense Technology（国防科技大学电子工程学院）；Anhui Province Key Laboratory of Cyberspace Security Situation Awareness and Evaluation（安徽省网络空间安全态势感知与评估重点实验室）；Institute of Computer Application, China Academy of Engineering Physics（中国工程物理研究院计算机应用研究所）
Existing weakly supervised sound event detection (WSSED) work has not explored both types of co-occurrences simultaneously, i.e., some sound events often co-occur, and their occurrences are usually accompanied by specific background sounds, so they would be inevitably entangled, causing misclassification and biased localization results with only clip-level supervision. To tackle this issue, we first establish a structural causal model (SCM) to reveal that the context is the main cause of co-occurrence confounders that mislead the model to learn spurious correlations between frames and clip-lev…
Latent variables often mask cause-effect relationships in observational data which provokes spurious links that may be misinterpreted as causal. This problem sparks great interest in the fields such as climate science and economics. We propose to estimate confounded causal links of time series using Sequential Causal Effect Variational Autoencoder (SCEVAE) while applying Knockoff interventions. Knockoff variables have the same distribution as the originals and preserve the correlation to other variables. This allows for counterfactuals that are more faithful to the observational distribution. …
Breaking the Spurious Causality of Conditional Generation via Fairness Intervention with Corrective Sampling
Samsung Advanced Institute of Technology (SAIT)（三星先进技术研究院）；Korea Advanced Institute of Science & Technology (KAIST)（韩国科学技术院）；Pohang University of Science and Technology (POSTECH)（浦项科技大学）
ACTIVA: Amortized Causal Effect Estimation via Transformer-based Variational Autoencoder
Learning and Reasoning Group（学习与推理组）；Vrije Universiteit Amsterdam（阿姆斯特丹自由大学）；Leiden Institute of Advanced Computer Science (LIACS)（莱顿先进计算机科学研究所）；Leiden University（莱顿大学）；Informatics Institute & Institute for Logic, Language and Computation（信息研究所及逻辑、语言与计算研究所）；University of Amsterdam（阿姆斯特丹大学）
University of Amsterdam（阿姆斯特丹大学）；Vrije Universiteit Amsterdam（阿姆斯特丹自由大学）
Machine learning models trained with purely observational data and the principle of empirical risk minimization \citep{vapnik_principles_1992} can fail to generalize to unseen domains. In this paper, we focus on the case where the problem arises through spurious correlation between the observed domains and the actual task labels. We find that many domain generalization methods do not explicitly take this spurious correlation into account. Instead, especially in more application-oriented research areas like medical imaging or robotics, data augmentation techniques that are based on heuristics a…
Mila - Québec AI Institute（米拉-魁北克人工智能研究所）；McGill University（麦吉尔大学）；ÉTS Montréal（蒙特利尔高等技术学院）
Learning predictors that do not rely on spurious correlations involves building causal representations. However, learning such a representation is very challenging. We, therefore, formulate the problem of learning a causal representation from high dimensional data and study causal recovery with synthetic data. This work introduces a latent variable decoder model, Decoder BCD, for Bayesian causal discovery and performs experiments in mildly supervised and unsupervised settings. We present a series of synthetic experiments to characterize important factors for causal discovery and show that usin…
Columbia University（哥伦比亚大学）；Rutgers University（罗格斯大学）
We introduce a framework for learning robust visual representations that generalize to new viewpoints, backgrounds, and scene contexts. Discriminative models often learn naturally occurring spurious correlations, which cause them to fail on images outside of the training distribution. In this paper, we show that we can steer generative models to manufacture interventions on features caused by confounding factors. Experiments, visualizations, and theoretical results show this method learns robust representations more consistent with the underlying causal relationships. Our approach improves per…
Causal Neighbourhood Learning for Invariant Graph Representations
School of Science, Engineering and Digital Technologies, University of Southern Queensland（科学、工程与数字技术学院，南方昆士兰大学）；School of Data Science, Lingnan University（数据科学学院，岭南大学）；School of Business, Law, Humanities and Pathways, University of Southern Queensland（商业、法律、人文与路径学院，南方昆士兰大学）
When Names Change Verdicts: Intervention Consistency Reveals Systematic Bias in LLM Decision-Making
Indian Institute of Information Technology, Allahabad (IIITA)（印度阿勒颇理工学院，阿勒颇（IIITA））；National Institute of Electronics and Information Technology (NIELIT)（国家电子与信息技术研究所（NIELIT））
Adversarial training is the de facto most promising defense against adversarial examples. Yet, its passive nature inevitably prevents it from being immune to unknown attackers. To achieve a proactive defense, we need a more fundamental understanding of adversarial examples, beyond the popular bounded threat model. In this paper, we provide a causal viewpoint of adversarial vulnerability: the cause is the spurious correlation ubiquitously existing in learning, i.e., the confounding effect, where attackers are precisely exploiting these effects. Therefore, a fundamental solution for adversarial …
Artemis: Anatomy-Resolved inTervention for Eliminating Multimodal NeuroImage confounderS
University of Pittsburgh（匹兹堡大学）；University of Maryland（马里兰大学）；University of Southern California（南加州大学）；Binghamton University（宾汉姆顿大学）；University of Texas Rio Grande Valley（德克萨斯大学里奥格兰德河谷分校）
Recent work for image captioning mainly followed an extract-then-generate paradigm, pre-extracting a sequence of object-based features and then formulating image captioning as a single sequence-to-sequence task. Although promising, we observed two problems in generated captions: 1) content inconsistency where models would generate contradicting facts; 2) not informative enough where models would miss parts of important information. From a causal perspective, the reason is that models have captured spurious statistical correlations between visual features and certain expressions (e.g., visual f…
Towards Robust Trajectory Representations: Isolating Environmental Confounders with Causal Learning
Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；University of Science and Technology of China（中国科学技术大学）；Beijing Institute of Technology（北京理工大学）
In recent years, there has been increasing interest in causal reasoning for designing fair decision-making systems due to its compatibility with legal frameworks, interpretability for human stakeholders, and robustness to spurious correlations inherent in observational data, among other factors. The recent attention to causal fairness, however, has been accompanied with great skepticism due to practical and epistemological challenges with applying current causal fairness approaches in the literature. Motivated by the long-standing empirical work on causality in econometrics, social sciences, a…
