arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.16467cs.NE
收藏

混合变量问题的探索性景观分析

Exploratory Landscape Analysis for Mixed-Variable Problems

Raphael Patrick Prager, Heike Trautmann

AI总结:

本文提出利用机器学习编码技术为混合连续、二进制、整数和分类变量的优化问题计算探索性景观特征,并通过聚类和自动化算法选择实验验证其有效性,将单一最佳与虚拟最佳求解器的差距缩小57.5%。

摘要:

探索性景观分析以及一般的适应度景观分析在促进问题理解、算法设计以及自动化算法选择与配置等方面一直发挥着关键作用。这些技术在很大程度上仅限于单一域的搜索空间。在本工作中,我们提供了为混合变量问题计算探索性景观特征的方法,其中决策空间是连续、二进制、整数和分类变量的混合。这是通过利用源自机器学习的现有编码技术来实现的。我们基于这些不同技术对结果进行了全面的并列比较。为了进一步突出它们在实际应用中的价值,我们基于一个超参数优化基准套件设计并开展了一项自动化算法选择研究。我们通过基于所使用的景观特征进行聚类,推导出这些基准问题的有意义划分。识别出的聚类模拟了所用算法表现出的行为。也就是说,不同的聚类具有不同的最佳执行算法。最后,我们训练出的算法选择器能够在所有基准问题上将单一最佳求解器与虚拟最佳求解器之间的差距缩小57.5%。

英文摘要:

Exploratory landscape analysis and fitness landscape analysis in general have been pivotal in facilitating problem understanding, algorithm design and endeavors such as automated algorithm selection and configuration. These techniques have largely been limited to search spaces of a single domain. In this work, we provide the means to compute exploratory landscape features for mixed-variable problems where the decision space is a mixture of continuous, binary, integer, and categorical variables. This is achieved by utilizing existing encoding techniques originating from machine learning. We provide a comprehensive juxtaposition of the results based on these different techniques. To further highlight their merit for practical applications, we design and conduct an automated algorithm selection study based on a hyperparameter optimization benchmark suite. We derive a meaningful compartmentalization of these benchmark problems by clustering based on the used landscape features. The identified clusters mimic the behavior the used algorithms exhibit. Meaning, the different clusters have different best performing algorithms. Finally, our trained algorithm selector is able to close the gap between the single best and the virtual best solver by 57.5% over all benchmark problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑