基于最大似然的CMA-ES超参数在线自适应
Maximum Likelihood-based Online Adaptation of Hyper-parameters in CMA-ES
摘要:
协方差矩阵自适应演化策略(CMA-ES)是一种求解非线性、非凸优化问题的鲁棒无导数连续优化算法。众所周知,CMA-ES几乎是无参数的,这意味着只有一个超参数,即人口规模,建议由用户调整。在本文中,我们提出了一个原则性的方法称为自我CMA-ES实现在线自适应的CMA-ES超参数,以提高其整体性能。实验结果表明,当种群规模大于默认值时,CMA-ES超参数的默认设置远不是最优的,而自CMA-ES允许动态逼近最优设置.
英文摘要:
The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is widely accepted as a robust derivative-free continuous optimization algorithm for non-linear and non-convex optimization problems. CMA-ES is well known to be almost parameterless, meaning that only one hyper-parameter, the population size, is proposed to be tuned by the user. In this paper, we propose a principled approach called self-CMA-ES to achieve the online adaptation of CMA-ES hyper-parameters in order to improve its overall performance. Experimental results show that for larger-than-default population size, the default settings of hyper-parameters of CMA-ES are far from being optimal, and that self-CMA-ES allows for dynamically approaching optimal settings.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。