arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1204.0171cs.LGcs.CV
收藏

一种新的模糊层叠泛化技术及其性能分析

A New Fuzzy Stacked Generalization Technique and Analysis of its Performance

Middle East Technical University(中东技术大学)

Mete Ozay, Fatos T. Yarman Vural

摘要:

在这项研究中,提出了一种新的堆叠泛化技术,称为模糊堆叠泛化(FSG),以尽量减少N样本和大样本的最近邻分类器的分类错误之间的差异。建议FSG采用了一种新的分层远程学习策略,以尽量减少误差的差异。为了这个目的,我们首先构建一个合奏的基本层模糊k-最近邻(k-NN)分类器,其中每个接收从相同的样本集提取的不同的特征集。在每个模糊k-NN分类器的决策空间处计算的模糊隶属度值被连接以形成融合空间的特征向量。最后,将特征向量馈送到元层分类器以学习用于元层分类的基本层分类器的决策的准确度。而不是单独的基本层分类器的功率,分类器的多样性和合作成为一个重要的问题,以提高所提出的FSG的整体性能。如果弱基本层分类器能够在其自身的特征空间中识别未被其余分类器识别的样本,则弱基本层分类器可以比强分类器更多地提升整体性能。实验探索的类型之间的合作所需的个人分类器的建议架构的性能提高。在多特征真实世界数据集上的实验表明,该方法的性能优于现有的集成学习算法,如Adaboost,随机子空间和旋转森林。另一方面,在单特征多属性数据集上的实验中观察到兼容的性能。

英文摘要:

In this study, a new Stacked Generalization technique called Fuzzy Stacked Generalization (FSG) is proposed to minimize the difference between N -sample and large-sample classification error of the Nearest Neighbor classifier. The proposed FSG employs a new hierarchical distance learning strategy to minimize the error difference. For this purpose, we first construct an ensemble of base-layer fuzzy k- Nearest Neighbor (k-NN) classifiers, each of which receives a different feature set extracted from the same sample set. The fuzzy membership values computed at the decision space of each fuzzy k-NN classifier are concatenated to form the feature vectors of a fusion space. Finally, the feature vectors are fed to a meta-layer classifier to learn the degree of accuracy of the decisions of the base-layer classifiers for meta-layer classification. Rather than the power of the individual base layer-classifiers, diversity and cooperation of the classifiers become an important issue to improve the overall performance of the proposed FSG. A weak base-layer classifier may boost the overall performance more than a strong classifier, if it is capable of recognizing the samples, which are not recognized by the rest of the classifiers, in its own feature space. The experiments explore the type of the collaboration among the individual classifiers required for an improved performance of the suggested architecture. Experiments on multiple feature real-world datasets show that the proposed FSG performs better than the state of the art ensemble learning algorithms such as Adaboost, Random Subspace and Rotation Forest. On the other hand, compatible performances are observed in the experiments on single feature multi-attribute datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑