arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.12675cs.NEcs.AI
收藏

MMES:基于混合模型的大规模优化演化策略

MMES: Mixture Model based Evolution Strategy for Large-Scale Optimization

Sun Yat-sen University(中山大学)

Xiaoyu He, Zibin Zheng, Yuren Zhou

摘要:

该工作为协方差矩阵自适应演化策略(CMA-ES)在大规模环境下的应用提供了一种有效的采样方法。与CMA-ES中的高斯采样相比,所提出的方法从混合模型生成突变向量,这有助于在有限的时间预算内利用问题景观的丰富变量相关性。我们分析了这种混合模型的概率分布,并表明它近似于高斯分布的CMA-ES与可控的精度。我们使用这种采样方法,再加上一种新的方法,突变强度适应,制定混合模型为基础的演化策略(MMES)-一个CMA-ES变种大规模优化。数值模拟结果表明,MMES在显著降低CMA-ES的时间复杂度的同时,保持了旋转不变性,可扩展到高维问题,并且在全局优化方面与现有技术相比具有竞争力.

英文摘要:

This work provides an efficient sampling method for the covariance matrix adaptation evolution strategy (CMA-ES) in large-scale settings. In contract to the Gaussian sampling in CMA-ES, the proposed method generates mutation vectors from a mixture model, which facilitates exploiting the rich variable correlations of the problem landscape within a limited time budget. We analyze the probability distribution of this mixture model and show that it approximates the Gaussian distribution of CMA-ES with a controllable accuracy. We use this sampling method, coupled with a novel method for mutation strength adaptation, to formulate the mixture model based evolution strategy (MMES) -- a CMA-ES variant for large-scale optimization. The numerical simulations show that, while significantly reducing the time complexity of CMA-ES, MMES preserves the rotational invariance, is scalable to high dimensional problems, and is competitive against the state-of-the-arts in performing global optimization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑