arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2208.02400cs.NEcs.AI
收藏

集成学习的进化装袋算法

Evolutionary bagging for ensemble learning

University of New South Wales(新南威尔士大学);UNSW Data Science Hub(新南威尔士大学数据科学中心);Australian Research Council - Industrial Transformation Training Centre(澳大利亚研究委员会工业转型培训中心)

Giang Ngo, Rodney Beard, Rohitash Chandra

摘要:

包围学习在机器学习中取得了成功,与其他学习方法相比具有重大优势。Bagging是一种重要的集成学习方法,它创建数据的子组,称为bags,这些数据由单独的机器学习方法(如决策树)进行训练。随机森林是在学习过程中具有附加特征的装袋的一个突出例子。进化算法在优化问题中表现突出,也被用于机器学习。进化算法是一种无梯度的方法,它处理一群候选解,这些候选解保持多样性以创建新的解。在传统的袋装集成学习中,袋被创建一次,并且内容(就训练样本而言)在学习过程中是固定的。在我们的论文中,我们提出了进化袋集成学习,我们利用进化算法来进化袋的内容,以便通过提供袋中的多样性来迭代增强集成。结果表明,我们的进化集成装袋方法优于传统的集成方法(装袋和随机森林)的几个基准数据集在一定的约束条件。我们发现,进化装袋本质上可以维持一组不同的袋子,而不会降低性能的准确性。

英文摘要:

Ensemble learning has gained success in machine learning with major advantages over other learning methods. Bagging is a prominent ensemble learning method that creates subgroups of data, known as bags, that are trained by individual machine learning methods such as decision trees. Random forest is a prominent example of bagging with additional features in the learning process. Evolutionary algorithms have been prominent for optimisation problems and also been used for machine learning. Evolutionary algorithms are gradient-free methods that work with a population of candidate solutions that maintain diversity for creating new solutions. In conventional bagged ensemble learning, the bags are created once and the content, in terms of the training examples, are fixed over the learning process. In our paper, we propose evolutionary bagged ensemble learning, where we utilise evolutionary algorithms to evolve the content of the bags in order to iteratively enhance the ensemble by providing diversity in the bags. The results show that our evolutionary ensemble bagging method outperforms conventional ensemble methods (bagging and random forests) for several benchmark datasets under certain constraints. We find that evolutionary bagging can inherently sustain a diverse set of bags without reduction in performance accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑