Recent developments enable the quantification of causal control given a structural causal model (SCM). This has been accomplished by introducing quantities which encode changes in the entropy of one variable when intervening on another. These measures, named causal entropy and causal information gain, aim to address limitations in existing information theoretical approaches for machine learning tasks where causality plays a crucial role. They have not yet been properly mathematically studied. Our research contributes to the formal understanding of the notions of causal entropy and causal information gain by establishing and analyzing fundamental properties of these concepts, including bounds and chain rules. Furthermore, we elucidate the relationship between causal entropy and stochastic interventions. We also propose definitions for causal conditional entropy and causal conditional information gain. Overall, this exploration paves the way for enhancing causal machine learning tasks through the study of recently-proposed information theoretic quantities grounded in considerations about causality.
Dictionary Based Pattern Entropy for Causal Direction Discovery
Department of Computer Science and Information Systems（计算机科学与信息系统系）；BITS Pilani K K Birla Goa Campus（比斯潘尼学院K K Birla Goa校区）；Complex Systems Programme（复杂系统计划）；National Institute of Advanced Studies（国家高级研究所）；Indian Institute of Technology Madras（印度理工学院马德拉斯分校）
copent: Estimating Copula Entropy and Transfer Entropy in R
统计独立性和条件独立性是统计学和机器学习中的两个基本概念。Copula熵是Ma和Sun定义的一个用于度量和检验多元统计独立性的数学概念，也被证明与条件独立性（或转移熵）密切相关。作为度量独立性和因果性的统一框架，并行工程已被应用于解决若干相关的统计或机器学习问题，包括关联发现、结构学习、变量选择和因果发现。Copula熵和传递熵的非参数估计方法也已提出。本文介绍了copent，R包，实现这些建议的方法估计copula熵和传递熵。介绍了该软件包的实现细节。三个例子与模拟数据和真实世界的数据变量的选择和因果关系的发现也展示了使用这个包。在变量选择和因果发现方面的实例表明，与相关软件包相比，copent具有较强的（条件）独立性检验能力。copent包可以在Comprehensive R Archive Network（CRAN）和GitHub上找到，网址是https://github.com/majianthu/copent。
Higher order definition of causality by optimally conditioned transfer entropy
Institute of Computer Science of the Czech Academy of Sciences（捷克科学院计算机科学研究所）；Faculty of Nuclear Sciences and Physical Engineering, Czech Technical University（捷克技术大学核科学与物理工程系）；National Institute of Mental Health（国家心理健康研究所）
Entropy Causal Graphs for Multivariate Time Series Anomaly Detection
Institute of Innovation, Science and Sustainability（创新、科学与可持续性研究所）；Federation University Australia, Australia and CSIRO's Data61（联邦大学澳大利亚分校和CSIRO的数据61）；Federation University Australia（联邦大学澳大利亚分校）；RMIT University（皇家墨尔本理工学院）
Towards Empowerment Gain through Causal Structure Learning in Model-Based RL
National Key Laboratory for Novel Software Technology, Nanjing University（南京大学计算机软件新技术国家重点实验室）；University of California, San Diego（加利福尼亚大学圣迭戈分校）；MBZUAI（Mohamed bin Zayed 人工智能大学）；University of Liverpool（利物浦大学）；School of Intelligence Science and Technology, Nanjing University（南京大学智能科学与技术学院）
EXaMCaP: Subset Selection with Entropy Gain Maximization for Probing Capability Gains of Large Chart Understanding Training Sets
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China（中国科学院信息工程研究所）；School of Cyberspace Security, University of Chinese Academy of Sciences, Beijing, China（中国科学院大学网络安全学院）；School of Computer and Artificial Intelligence, Jiangxi University of Finance and Economics（江西财经大学计算机与人工智能学院）
