arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1402.0570cs.LG
收藏

一种特征子集选择算法的自动推荐方法

A Feature Subset Selection Algorithm Automatic Recommendation Method

Xi’an Jiaotong University(西安交通大学);Nanjing University(南京大学)

Guangtao Wang, Qinbao Song, Heli Sun, Xueying Zhang, Baowen Xu, Yuming Zhou

摘要:

许多特征子集选择(FSS)算法已经被提出,但并不是所有的都是适合于一个给定的特征选择问题。同时,到目前为止,很少有一个很好的方法来选择合适的FSS算法的问题。因此,FSS算法的自动推荐具有重要的现实意义。提出了一种基于元学习的FSS算法自动推荐方法。该方法首先通过k-近邻分类算法确定与当前数据最相似的数据集,然后根据常用数据集特征计算这些数据集之间的距离。然后,根据它们在这些相似数据集上的性能对所有候选FSS算法进行排名,并选择性能最好的算法作为合适的算法。候选FSS算法的性能评估的多标准度量,考虑到不仅在所选功能的分类精度,但也运行时的特征选择和所选功能的数量。建议的推荐方法进行了广泛的测试,在115个真实世界的数据集与22个著名的和常用的不同的FSS算法的五个代表性的分类。实验结果表明了本文提出的FSS算法推荐方法的有效性。

英文摘要:

Many feature subset selection (FSS) algorithms have been proposed, but not all of them are appropriate for a given feature selection problem. At the same time, so far there is rarely a good way to choose appropriate FSS algorithms for the problem at hand. Thus, FSS algorithm automatic recommendation is very important and practically useful. In this paper, a meta learning based FSS algorithm automatic recommendation method is presented. The proposed method first identifies the data sets that are most similar to the one at hand by the k-nearest neighbor classification algorithm, and the distances among these data sets are calculated based on the commonly-used data set characteristics. Then, it ranks all the candidate FSS algorithms according to their performance on these similar data sets, and chooses the algorithms with best performance as the appropriate ones. The performance of the candidate FSS algorithms is evaluated by a multi-criteria metric that takes into account not only the classification accuracy over the selected features, but also the runtime of feature selection and the number of selected features. The proposed recommendation method is extensively tested on 115 real world data sets with 22 well-known and frequently-used different FSS algorithms for five representative classifiers. The results show the effectiveness of our proposed FSS algorithm recommendation method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑