arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2307.14643cs.LGcs.AI
收藏

MVMR-FS:基于最大类间差异和最小冗余的非参数特征选择算法

MVMR-FS : Non-parametric feature selection algorithm based on Maximum inter-class Variation and Minimum Redundancy

Central South University(中南大学)

Haitao Nie, Shengbo Zhang, Bin Xie

AI总结:

提出非参数特征选择算法MVMR-FS,通过核密度估计和最大类间差异与最小冗余准则度量特征相关性和冗余性,并利用AGA搜索最优特征子集,相比十种先进方法准确率提升5%至11%。

摘要:

如何准确度量特征的相关性和冗余性是特征选择领域的一个长期挑战。然而,现有的基于过滤式的特征选择方法无法直接度量连续数据的冗余性。此外,大多数方法依赖人工指定特征数量,在缺乏专家知识时可能会引入误差。在本文中,我们提出了一种基于最大类间差异和最小冗余的非参数特征选择算法,简称为MVMR-FS。我们首先在特征上引入有监督和无监督的核密度估计,以捕获它们在类间和整体分布中的相似性和差异。随后,我们提出了最大类间差异和最小冗余(MVMR)准则,其中类间概率分布用于反映特征相关性,整体概率分布之间的距离用于量化冗余性。最后,我们采用AGA搜索最小化MVMR的特征子集。与十种最先进的方法相比,MVMR-FS取得了最高的平均准确率,并将准确率提高了5%到11%。

英文摘要:

How to accurately measure the relevance and redundancy of features is an age-old challenge in the field of feature selection. However, existing filter-based feature selection methods cannot directly measure redundancy for continuous data. In addition, most methods rely on manually specifying the number of features, which may introduce errors in the absence of expert knowledge. In this paper, we propose a non-parametric feature selection algorithm based on maximum inter-class variation and minimum redundancy, abbreviated as MVMR-FS. We first introduce supervised and unsupervised kernel density estimation on the features to capture their similarities and differences in inter-class and overall distributions. Subsequently, we present the criteria for maximum inter-class variation and minimum redundancy (MVMR), wherein the inter-class probability distributions are employed to reflect feature relevance and the distances between overall probability distributions are used to quantify redundancy. Finally, we employ an AGA to search for the feature subset that minimizes the MVMR. Compared with ten state-of-the-art methods, MVMR-FS achieves the highest average accuracy and improves the accuracy by 5% to 11%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑