arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2006.04877stat.MEcs.LGstat.CO
收藏

异质总体的因果方向检验

A Causal Direction Test for Heterogeneous Populations

Huawei Noah’s Ark Lab(华为诺亚方舟实验室);McGill University(麦吉尔大学);The Chinese University of Hong Kong(香港中文大学)

Vahid Partovi Nia, Xinlin Li, Masoud Asgharian, Shoubo Hu, Zhitang Chen, Yanhui Geng

摘要:

概率专家系统通过有向图模型模拟人类专家的决策能力。构建这样的系统的第一步是理解数据生成机制。为此,可以尝试将多变量分布分解为若干条件的乘积,并将黑盒机器学习预测模型朝着透明的因果发现发展。大多数因果模型假设一个单一的同质人口,一个假设,可能无法在许多应用程序。我们发现,当同质性假设被违反,因果模型开发的基础上,这样的假设可能无法识别正确的因果方向。我们提出了一种调整,以常用的因果方向检验统计量,通过使用$k$ -均值类型的聚类算法,标签和组件的数量估计从收集的数据,以调整检验统计量。我们的模拟结果表明,所提出的调整显着提高性能的因果方向检验统计量异质数据。我们研究了我们提出的检验统计量的大样本行为,并使用实际数据证明了所提出的方法的应用。

英文摘要:

A probabilistic expert system emulates the decision-making ability of a human expert through a directional graphical model. The first step in building such systems is to understand data generation mechanism. To this end, one may try to decompose a multivariate distribution into product of several conditionals, and evolving a blackbox machine learning predictive models towards transparent cause-and-effect discovery. Most causal models assume a single homogeneous population, an assumption that may fail to hold in many applications. We show that when the homogeneity assumption is violated, causal models developed based on such assumption can fail to identify the correct causal direction. We propose an adjustment to a commonly used causal direction test statistic by using a $k$-means type clustering algorithm where both the labels and the number of components are estimated from the collected data to adjust the test statistic. Our simulation result show that the proposed adjustment significantly improves the performance of the causal direction test statistic for heterogeneous data. We study large sample behaviour of our proposed test statistic and demonstrate the application of the proposed method using real data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑