掀翻学习者脚下的地毯:在概念漂移场景下学习集成机器学习模型的遗传算法
Pulling the Carpet Below the Learner's Feet: Genetic Algorithm To Learn Ensemble Machine Learning Model During Concept Drift
AI总结:
针对动态环境下的概念漂移挑战,提出一种结合遗传算法的双层集成机器学习模型,通过带独立概念漂移检测器的流水线模型种群与全局聚合结构,结合自动ML方法优化,在合成数据集上性能优于单流水线模型,为复杂概念漂移处理提供新方案。
摘要:
近年来,数据驱动模型尤其是机器学习(ML)模型在科学与工程领域的应用日益广泛,愈发受到关注。在真实动态环境中部署ML模型时,用户通常需要应对概念漂移(CD)带来的挑战。本研究探索了遗传算法(GA)在此类场景下应对CD挑战的应用。我们提出了一种新颖的双层集成ML模型,该模型将全局ML模型与CD检测器相结合,作为ML流水线模型种群的聚合器;种群中的每个流水线模型都配有独立调整的CD检测器,负责自身ML模型的重训练。此外,我们还证明利用现成的自动ML方法可进一步优化所提模型。通过大量合成数据集分析,我们发现所提模型的性能优于配备CD算法的单ML流水线,尤其在CD特征未知的场景中优势更明显。总体而言,本研究凸显了通过GA这类启发式自适应优化过程得到的集成ML与CD模型,在应对复杂CD事件方面的潜力。
英文摘要:
Data-driven models, in general, and machine learning (ML) models, in particular, have gained popularity over recent years with an increased usage of such models across the scientific and engineering domains. When using ML models in realistic and dynamic environments, users need to often handle the challenge of concept drift (CD). In this study, we explore the application of genetic algorithms (GAs) to address the challenges posed by CD in such settings. We propose a novel two-level ensemble ML model, which combines a global ML model with a CD detector, operating as an aggregator for a population of ML pipeline models, each one with an adjusted CD detector by itself responsible for re-training its ML model. In addition, we show one can further improve the proposed model by utilizing off-the-shelf automatic ML methods. Through extensive synthetic dataset analysis, we show that the proposed model outperforms a single ML pipeline with a CD algorithm, particularly in scenarios with unknown CD characteristics. Overall, this study highlights the potential of ensemble ML and CD models obtained through a heuristic and adaptive optimization process such as the GA one to handle complex CD events.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。