arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.05844cs.AIcs.LGstat.ML
收藏

因果和非因果特征选择的统一观点

A Unified View of Causal and Non-causal Feature Selection

University of South Australia(南澳大学)

Kui Yu, Lin Liu, Jiuyong Li

摘要:

在本文中,我们的目标是发展一个因果和非因果特征选择方法的统一观点。统一的观点将填补两类方法关系研究的空白。基于贝叶斯网络框架和信息论,我们首先表明,因果和非因果特征选择方法共享相同的目标。也就是说,找到一个类属性的马尔可夫毯,理论上最优的分类特征集。然后,我们研究因果和非因果特征选择方法在搜索最优特征集时所做的假设,并通过将其映射到所研究问题的贝叶斯网络模型结构上的限制来统一假设。我们进一步详细分析了结构假设如何导致在搜索中所采用的方法的不同程度的近似,然后导致在特征集中的近似,这些方法相对于最佳特征集找到。有了统一的观点,我们能够从因果的角度解释非因果方法的输出,并推导出两种方法的误差界。最后,我们提出的因果关系和非因果关系的方法,使用广泛的实验与合成数据和各种类型的真实数据之间的关系的实际理解。

英文摘要:

In this paper, we aim to develop a unified view of causal and non-causal feature selection methods. The unified view will fill in the gap in the research of the relation between the two types of methods. Based on the Bayesian network framework and information theory, we first show that causal and non-causal feature selection methods share the same objective. That is to find the Markov blanket of a class attribute, the theoretically optimal feature set for classification. We then examine the assumptions made by causal and non-causal feature selection methods when searching for the optimal feature set, and unify the assumptions by mapping them to the restrictions on the structure of the Bayesian network model of the studied problem. We further analyze in detail how the structural assumptions lead to the different levels of approximations employed by the methods in their search, which then result in the approximations in the feature sets found by the methods with respect to the optimal feature set. With the unified view, we are able to interpret the output of non-causal methods from a causal perspective and derive the error bounds of both types of methods. Finally, we present practical understanding of the relation between causal and non-causal methods using extensive experiments with synthetic data and various types of real-word data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑