arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1408.1487cs.AI
收藏

基于互信息分布的鲁棒特征选择

Robust Feature Selection by Mutual Information Distributions

IDSIA(瑞士人工智能研究所)

Marco Zaffalon, Marcus Hutter

摘要:

互信息广泛应用于人工智能中,以描述的方式度量离散随机变量的随机依赖性。为了解决诸如经验值的可靠性之类的问题,必须考虑样本到人口的推理方法。本文讨论了互信息的分布,在贝叶斯框架下获得的二阶Dirichlet先验分布。的平均值和方差的分析近似的精确解析表达式的报告。提出了分布的渐近近似。结果被施加到问题的选择功能的增量学习和分类的朴素贝叶斯分类器。结果表明,一种快速、新定义的方法优于基于大量真实数据集的经验互信息的传统方法。最后,一个理论的发展报告,允许一个有效地扩展上述方法不完整的样本中一个简单而有效的方式。

英文摘要:

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must consider sample-to-population inferential approaches. This paper deals with the distribution of mutual information, as obtained in a Bayesian framework by a second-order Dirichlet prior distribution. The exact analytical expression for the mean and an analytical approximation of the variance are reported. Asymptotic approximations of the distribution are proposed. The results are applied to the problem of selecting features for incremental learning and classification of the naive Bayes classifier. A fast, newly defined method is shown to outperform the traditional approach based on empirical mutual information on a number of real data sets. Finally, a theoretical development is reported that allows one to efficiently extend the above methods to incomplete samples in an easy and effective way.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑