A decision-maker must consider cofounding bias when attempting to apply machine learning prediction, and, while feature selection is widely recognized as important process in data-analysis, it could cause cofounding bias. A causal Bayesian network is a standard tool for describing causal relationships, and if relationships are known, then adjustment criteria can determine with which features cofounding bias disappears. A standard modification would thus utilize causal discovery algorithms for preventing cofounding bias in feature selection. Causal discovery algorithms, however, essentially rely on the faithfulness assumption, which turn out to be easily violated in practical feature selection settings. In this paper, we propose a meta-algorithm that can remedy existing feature selection algorithms in terms of cofounding bias. Our algorithm is induced from a novel adjustment criterion that requires rather than faithfulness, an assumption which can be induced from another well-known assumption of the causal sufficiency. We further prove that the features added through our modification convert cofounding bias into prediction variance. With the aid of existing robust optimization technologies that regularize risky strategies with high variance, then, we are able to successfully improve the throughput performance of decision-making optimization, as is shown in our experimental results.
Federated Causality Learning with Explainable Adaptive Optimization
School of Software, Shandong University（山东大学软件学院）；SDU-NTU Joint Centre for AI Research, Shandong University（山东大学-新加坡南洋理工大学人工智能联合研究中心）；Department of Mathematics, National University of Singapore（新加坡国立大学数学系）；Departiment of Computer Science, George Mason University（乔治梅森大学计算机系）；School of Control Science and Engineering, Shandong University（山东大学控制科学与工程学院）
针对隐私保护下分散异构数据的因果发现问题，提出 FedCausal 联邦策略，通过可解释的自适应优化统一局部与全局 DAG 学习，在 non-iid 合成及真实数据上表现优越。
We discuss recent work for causal inference and predictive robustness in a unifying way. The key idea relies on a notion of probabilistic invariance or stability: it opens up new insights for formulating causality as a certain risk minimization problem with a corresponding notion of robustness. The invariance itself can be estimated from general heterogeneous or perturbation data which frequently occur with nowadays data collection. The novel methodology is potentially useful in many applications, offering more robustness and better `causal-oriented' interpretation than machine learning or est…
University of Copenhagen（哥本哈根大学）；Technical University of Denmark（丹麦技术大学）；University of Amsterdam（阿姆斯特丹大学）
This PhD thesis contains several contributions to the field of statistical causal modeling. Statistical causal models are statistical models embedded with causal assumptions that allow for the inference and reasoning about the behavior of stochastic systems affected by external manipulation (interventions). This thesis contributes to the research areas concerning the estimation of causal effects, causal structure learning, and distributionally robust (out-of-distribution generalizing) prediction methods. We present novel and consistent linear and non-linear causal effects estimators in instrum…
While probabilistic models describe the dependence structure between observed variables, causal models go one step further: they predict, for example, how cognitive functions are affected by external interventions that perturb neuronal activity. In this review and perspective article, we introduce the concept of causality in the context of cognitive neuroscience and review existing methods for inferring causal relationships from data. Causal inference is an ambitious task that is particularly challenging in cognitive neuroscience. We discuss two difficulties in more detail: the scarcity of int…
Pennsylvania State University（宾夕法尼亚州立大学）；Purdue University（普渡大学）
As virtually all aspects of our lives are increasingly impacted by algorithmic decision making systems, it is incumbent upon us as a society to ensure such systems do not become instruments of unfair discrimination on the basis of gender, race, ethnicity, religion, etc. We consider the problem of determining whether the decisions made by such systems are discriminatory, through the lens of causal models. We introduce two definitions of group fairness grounded in causality: fair on average causal effect (FACE), and fair on average causal effect on the treated (FACT). We use the Rubin-Neyman pot…
Deciphering interventional dynamical causality from non-intervention complex systems
Research Institute of Intelligent Complex Systems & CISOR, Fudan University（智能复杂系统研究所及CISOR，复旦大学）；International Research Center for Neurointelligence, The University of Tokyo Institutes for Advanced Study, The University of Tokyo（神经智能国际研究中心，东京大学先进研究所，东京大学）；School of Pharmacy, Shanghai University of Traditional Chinese Medicine（上海中医药大学药学院）；Institute of AI and Robotics, College of Intelligent Robotics and Advanced Manufacturing, Fudan University（人工智能与机器人研究所，智能机器人与先进制造学院，复旦大学）；Frontiers Science Center for Deep Ocean Multispheres and Earth System, Key Laboratory of Marine Chemistry Theory and Technology, Ministry of Education, Ocean University of China（深海多球体与地球系统前沿科学中心，海洋化学理论与技术重点实验室，教育部，中国海洋大学）；School of Mathematical Sciences and School of AI, Shanghai Jiao Tong University（数学科学学院和人工智能学院，上海交通大学）；Key Laboratory of Systems Health Science of Zhejiang Province, Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Chinese Academy of Sciences（浙江省系统健康科学重点实验室，杭州高级研究所，中国科学院大学，中国科学院）
Conventional methods for causal structure learning from data face significant challenges due to combinatorial search space. Recently, the problem has been formulated into a continuous optimization framework with an acyclicity constraint to learn Directed Acyclic Graphs (DAGs). Such a framework allows the utilization of deep generative models for causal structure learning to better capture the relations between data sample distributions and DAGs. However, so far no study has experimented with the use of Wasserstein distance in the context of causal structure learning. Our model named DAG-WGAN c…
Knowledge Abstraction for Knowledge-based Semantic Communication: A Generative Causality Invariant Approach
Department of Intelligent Computing and Data Science, VinUniversity（智能计算与数据科学系，文大学）；School of Computer Science and Statistics, Trinity College Dublin（计算机科学与统计学系，三一学院）；School of Computer Science, The University of Sydney（计算机科学系，悉尼大学）；School of Engineering, The University of Newcastle（工程系，新castle大学）；Department of Information Convergence Engineering, Pusan National University（信息融合工程系，釜山国立大学）
The causal mechanism between climate and political violence is fraught with complex mechanisms. Current quantitative causal models rely on one or more assumptions: (1) the climate drivers persistently generate conflict, (2) the causal mechanisms have a linear relationship with the conflict generation parameter, and/or (3) there is sufficient data to inform the prior distribution. Yet, we know conflict drivers often excite a social transformation process which leads to violence (e.g., drought forces agricultural producers to join urban militia), but further climate effects do not necessarily co…
We consider the problem of predicting a response variable from a set of covariates on a data set that differs in distribution from the training data. Causal parameters are optimal in terms of predictive accuracy if in the new distribution either many variables are affected by interventions or only some variables are affected, but the perturbations are strong. If the training and test distributions differ by a shift, causal parameters might be too conservative to perform well on the above task. This motivates anchor regression, a method that makes use of exogeneous variables to solve a relaxati…
Curious Causality-Seeking Agents Learn Meta Causal World
University of Bristol（布里斯托大学）；Peking University（北京大学）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；School of Artificial Intelligence, Chinese Academy of Sciences（中国科学院人工智能学院）；University College London（伦敦大学学院）；King Abdullah University of Science and Technology（卡塔尔科技大学）；The Swiss AI Lab, IDSIA-USI/SUPSI（瑞士AI实验室，IDSIA-USI/SUPSI）
Language Agents Meet Causality -- Bridging LLMs and Causal World Models
University of Amsterdam（阿姆斯特丹大学）；Institute for Logic, Language and Computation (ILLC)（逻辑、语言与计算研究所）；University of Edinburgh（爱丁堡大学）；Institute for Language, Cognition and Computation (ILCC)（语言、认知与计算研究所）
Wiener-Granger causality is a widely used framework of causal analysis for temporally resolved events. We introduce a new measure of Wiener-Granger causality based on kernelization of partial canonical correlation analysis with specific advantages in the context of large high-dimensional data. The introduced measure is able to detect non-linear and non-monotonous signals, is designed to be immune to noise, and offers tunability in terms of computational complexity in its estimations. Furthermore, we show that, under specified conditions, the introduced measure can be regarded as an estimate of…
Causal and attribution studies are essential for earth scientific discoveries and critical for informing climate, ecology, and water policies. However, the current generation of methods needs to keep pace with the complexity of scientific and stakeholder challenges and data availability combined with the adequacy of data-driven methods. Unless carefully informed by physics, they run the risk of conflating correlation with causation or getting overwhelmed by estimation inaccuracies. Given that natural experiments, controlled trials, interventions, and counterfactual examinations are often impra…
University of Arkansas（阿肯色大学）；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）
A recent trend of fair machine learning is to define fairness as causality-based notions which concern the causal connection between protected attributes and decisions. However, one common challenge of all causality-based fairness notions is identifiability, i.e., whether they can be uniquely measured from observational data, which is a critical barrier to applying these notions to real-world situations. In this paper, we develop a framework for measuring different causality-based fairness. We propose a unified definition that covers most of previous causality-based fairness notions, namely th…
Inferring causal interactions from observed data is a challenging problem, especially in the presence of measurement noise. To alleviate the problem of spurious causality, Haufe et al. (2013) proposed to contrast measures of information flow obtained on the original data against the same measures obtained on time-reversed data. They show that this procedure, time-reversed Granger causality (TRGC), robustly rejects causal interpretations on mixtures of independent signals. While promising results have been achieved in simulations, it was so far unknown whether time reversal leads to valid measu…
Hefei University of Technology（合肥工业大学）；University of South Australia（南澳大学）；Mininglamp Academy of Sciences, Mininglamp Technology（明略科技明略科学院）
Feature selection is a crucial preprocessing step in data analytics and machine learning. Classical feature selection algorithms select features based on the correlations between predictive features and the class variable and do not attempt to capture causal relationships between them. It has been shown that the knowledge about the causal relationships between features and the class variable has potential benefits for building interpretable and robust prediction models, since causal relationships imply the underlying mechanism of a system. Consequently, causality-based feature selection has gr…
University of Bergen（卑尔根大学）；isee systems inc.（isee系统公司）
This paper presents a new causal network learning algorithm (FSNN, Feedback System Neural Network) based on the construction and analysis of a non-linear system of Ordinary Differential Equations (ODEs). The constructed system provides insight into the mechanisms responsible for generating the past and potential future behavior of dynamic systems. It is also interpretable in terms of real system variables, providing a wholistic, causally accurate, and systemic understanding of the real-life interactions governing observed phenomena. This paper demonstrates the generation of an n-dimensional or…
InstaDeep Ltd.（InstaDeep有限公司）；University of Cape Town（开普敦大学）
This paper serves to introduce the reader to the field of multi-agent reinforcement learning (MARL) and its intersection with methods from the study of causality. We highlight key challenges in MARL and discuss these in the context of how causal methods may assist in tackling them. We promote moving toward a 'causality first' perspective on MARL. Specifically, we argue that causality can offer improved safety, interpretability, and robustness, while also providing strong theoretical guarantees for emergent behaviour. We discuss potential solutions for common challenges, and use this context to…
Identifying the causal structure of systems with multiple dynamic elements is critical to several scientific disciplines. The conventional approach is to conduct statistical tests of causality, for example with Granger Causality, between observed signals that are selected a priori. Here it is posited that, in many systems, the causal relations are embedded in a latent space that is expressed in the observed data as a linear mixture. A technique for blindly identifying the latent sources is presented: the observations are projected into pairs of components -- driving and driven -- to maximize t…
Utilizing Causal Network Markers to Identify Tipping Points ahead of Critical Transition
Fudan University（复旦大学）；Shanghai Center for Mathematical Sciences（上海数学科学中心）；Research Institute of Intelligent Complex Systems（智能复杂系统研究院）；Institute of AI and Robotics, Academy for Engineering and Technology（工程与技术研究院人工智能与机器人研究所）；Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）
