基于偏度的异方差噪声因果发现准则
A Skewness-Based Criterion for Addressing Heteroscedastic Noise in Causal Discovery
AI总结:
针对因果发现中的异方差噪声,提出基于得分偏度的新准则,并扩展至多元场景,设计SkewScore算法,无需提取外生噪声,实验验证有效。
摘要:
现实世界的数据常常违反等方差假设(同方差性),因此在因果发现中考虑异方差噪声至关重要。在本工作中,我们探索了异方差对称噪声模型(HSNMs),其中效应$Y$被建模为$Y = f(X) + σ(X)N$,其中$X$为原因,$N$为遵循对称分布的独立噪声。我们引入了一种基于数据分布得分(即对数密度的梯度)的偏度来识别HSNMs的新准则。该准则建立了一种计算上易处理的度量,该度量在因果方向上为零,而在反因果方向上非零,从而能够实现因果方向的发现。我们将这种基于偏度的准则扩展到多元设置,并提出了SkewScore算法,该算法无需提取外生噪声即可处理异方差噪声。我们还针对具有潜在混杂变量的双变量模型进行了SkewScore鲁棒性的案例研究,为其性能提供了理论见解。实证研究进一步验证了所提方法的有效性。
英文摘要:
Real-world data often violates the equal-variance assumption (homoscedasticity), making it essential to account for heteroscedastic noise in causal discovery. In this work, we explore heteroscedastic symmetric noise models (HSNMs), where the effect $Y$ is modeled as $Y = f(X) + σ(X)N$, with $X$ as the cause and $N$ as independent noise following a symmetric distribution. We introduce a novel criterion for identifying HSNMs based on the skewness of the score (i.e., the gradient of the log density) of the data distribution. This criterion establishes a computationally tractable measurement that is zero in the causal direction but nonzero in the anticausal direction, enabling the causal direction discovery. We extend this skewness-based criterion to the multivariate setting and propose SkewScore, an algorithm that handles heteroscedastic noise without requiring the extraction of exogenous noise. We also conduct a case study on the robustness of SkewScore in a bivariate model with a latent confounder, providing theoretical insights into its performance. Empirical studies further validate the effectiveness of the proposed method.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。