arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.07877cs.LGcs.AIstat.ML
收藏

将同质集成池化以构建异质集成

Pooling homogeneous ensembles to build heterogeneous ones

Maryam Sabzevari, Gonzalo Martínez-Muñoz, Alberto Suárez

摘要:

在集成方法中,不同分类器的集合的输出被组合在一起,期望全局预测比个体预测更准确。异质集成由不同类型的预测因子组成,它们可能具有不同的偏差。如果这些偏见是互补的,那么它们的决策组合是有益的。在这项工作中,一个家庭的异构集成建立池分类器从M个同质集成不同类型的大小T。根据每种类型的基本分类器的分数,在这个家庭中的一个特定的异质组合表示为一个点在一个正常的单形在M维。这个单形的M个顶点表示不同的齐次系综。从这些顶点之一的位移影响到相应的均匀的合奏到一个异构的平滑变换。这种异质性集合的最佳组成可以使用交叉验证来确定,或者如果使用自助样本来构建个体分类器,则可以使用袋外数据来确定。对由神经网络、支持向量机和随机树(即来自标准随机森林)组成的自举系综的这种组合的实证分析说明了这种异构系综创建方法可以实现的收益。

英文摘要:

In ensemble methods, the outputs of a collection of diverse classifiers are combined in the expectation that the global prediction be more accurate than the individual ones. Heterogeneous ensembles consist of predictors of different types, which are likely to have different biases. If these biases are complementary, the combination of their decisions is beneficial. In this work, a family of heterogeneous ensembles is built by pooling classifiers from M homogeneous ensembles of different types of size T. Depending on the fraction of base classifiers of each type, a particular heterogeneous combination in this family is represented by a point in a regular simplex in M dimensions. The M vertices of this simplex represent the different homogeneous ensembles. A displacement away from one of these vertices effects a smooth transformation of the corresponding homogeneous ensemble into a heterogeneous one. The optimal composition of such heterogeneous ensemble can be determined using cross-validation or, if bootstrap samples are used to build the individual classifiers, out-of-bag data. An empirical analysis of such combinations of bootstraped ensembles composed of neural networks, SVMs, and random trees (i.e. from a standard random forest) illustrates the gains that can be achieved by this heterogeneous ensemble creation method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑