超参数调整对景观感知性能回归的影响及算法选择
The Impact of Hyper-Parameter Tuning for Landscape-Aware Performance Regression and Algorithm Selection
摘要:
在演化计算中,基于探索性景观分析(ELA)的算法自动选择和配置方法正变得非常流行。然而,尽管应用数量显著增长,但底层机器学习模型通常以自组织方式选择。在这项工作中,我们表明,三个经典的回归方法是能够实现有意义的结果,基于ELA的算法选择。对于这三种模型--随机森林、决策树和装袋决策树--回归模型的质量受到所选超参数的高度影响。这对建立在这些回归之上的算法选择器的质量也有显著的影响。通过比较总数为30个不同的模型,每一个加上2个互补的回归策略,我们得出的回归模型的调整准则,并提供一般性的建议,更系统地使用经典的机器学习模型的算法选择。我们指出,机器学习模型的选择值得仔细进行和进一步研究。
英文摘要:
Automated algorithm selection and configuration methods that build on exploratory landscape analysis (ELA) are becoming very popular in Evolutionary Computation. However, despite a significantly growing number of applications, the underlying machine learning models are often chosen in an ad-hoc manner. We show in this work that three classical regression methods are able to achieve meaningful results for ELA-based algorithm selection. For those three models -- random forests, decision trees, and bagging decision trees -- the quality of the regression models is highly impacted by the chosen hyper-parameters. This has significant effects also on the quality of the algorithm selectors that are built on top of these regressions. By comparing a total number of 30 different models, each coupled with 2 complementary regression strategies, we derive guidelines for the tuning of the regression models and provide general recommendations for a more systematic use of classical machine learning models in landscape-aware algorithm selection. We point out that a choice of the machine learning model merits to be carefully undertaken and further investigated.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。