基于边际概率的整数处理方法用于 CMA-ES 解决单目标和多目标混合整数黑盒优化
Marginal Probability-Based Integer Handling for CMA-ES Tackling Single-and Multi-Objective Mixed-Integer Black-Box Optimization
AI总结:
针对CMA-ES在混合整数黑盒优化中因离散化导致优化停滞的问题,提出基于边际概率下界的整数处理方法,并成功扩展至多目标优化。
摘要:
本研究针对混合整数黑盒优化(MI-BBO)问题,即需要同时优化连续变量和整数变量的问题。CMA-ES 是本研究的重点,它是一种基于种群的无随机搜索方法,从多元高斯分布(MGD)中采样候选解,在连续 BBO 中表现出优异的性能。MGD 的参数(均值和(协)方差)在 CMA-ES 中基于候选解的评估值进行更新。然而,如果将 CMA-ES 通过简单的离散化应用于 MI-BBO,在达到最优解之前,与整数变量对应的方差会变得远小于离散化的粒度,从而导致优化停滞。特别是当问题中包含二元变量时,由于离散化粒度变宽,这种停滞更容易发生,而现有的 CMA-ES 整数处理方法无法解决此停滞问题。为克服这些限制,我们提出了一种简单的 CMA-ES 整数处理方法,基于对 MGD 中生成整数变量相关的边际概率设定下界。在 MI-BBO 基准问题上的数值实验证明了所提方法的效率和鲁棒性。此外,为了证明所提方法思想的通用性,除了单目标优化情形外,我们将其整合到多目标 CMA-ES 中,并在双目标混合整数基准问题上验证了其性能。
英文摘要:
This study targets the mixed-integer black-box optimization (MI-BBO) problem where continuous and integer variables should be optimized simultaneously. The CMA-ES, our focus in this study, is a population-based stochastic search method that samples solution candidates from a multivariate Gaussian distribution (MGD), which shows excellent performance in continuous BBO. The parameters of MGD, mean and (co)variance, are updated based on the evaluation value of candidate solutions in the CMA-ES. If the CMA-ES is applied to the MI-BBO with straightforward discretization, however, the variance corresponding to the integer variables becomes much smaller than the granularity of the discretization before reaching the optimal solution, which leads to the stagnation of the optimization. In particular, when binary variables are included in the problem, this stagnation more likely occurs because the granularity of the discretization becomes wider, and the existing integer handling for the CMA-ES does not address this stagnation. To overcome these limitations, we propose a simple integer handling for the CMA-ES based on lower-bounding the marginal probabilities associated with the generation of integer variables in the MGD. The numerical experiments on the MI-BBO benchmark problems demonstrate the efficiency and robustness of the proposed method. Furthermore, in order to demonstrate the generality of the idea of the proposed method, in addition to the single-objective optimization case, we incorporate it into multi-objective CMA-ES and verify its performance on bi-objective mixed-integer benchmark problems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。