使用基于MDL的局部和全局回归区分因果关系
Telling Cause from Effect using MDL-based Local and Global Regression
摘要:
我们考虑从观测数据推断两个单变量数值随机变量$X$和$Y$之间因果方向的基本问题。两个变量的情况特别难以解决,因为不可能在变量之间使用标准的条件独立性测试。为了解决这个问题,我们遵循基于Kolmogorov复杂性的信息理论方法,并使用最小描述长度(MDL)原则提供了一个实用的解决方案。特别是,我们提出了一个压缩方案,编码本地和全球的功能关系,使用基于MDL的回归。在将$Y$描述为$X$的函数比逆方向更短的情况下,我们推断$X$导致$Y$。此外,我们还介绍了斜率,一个有效的线性时间算法,通过对合成数据和真实世界数据的全面经验评估,我们显示出远远优于现有技术。
英文摘要:
We consider the fundamental problem of inferring the causal direction between two univariate numeric random variables $X$ and $Y$ from observational data. The two-variable case is especially difficult to solve since it is not possible to use standard conditional independence tests between the variables. To tackle this problem, we follow an information theoretic approach based on Kolmogorov complexity and use the Minimum Description Length (MDL) principle to provide a practical solution. In particular, we propose a compression scheme to encode local and global functional relations using MDL-based regression. We infer $X$ causes $Y$ in case it is shorter to describe $Y$ as a function of $X$ than the inverse direction. In addition, we introduce Slope, an efficient linear-time algorithm that through thorough empirical evaluation on both synthetic and real world data we show outperforms the state of the art by a wide margin.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。