arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1406.2623cs.NEcs.AI
收藏

基于最大似然的CMA-ES超参数在线自适应

Maximum Likelihood-based Online Adaptation of Hyper-parameters in CMA-ES

École Polytechnique Fédérale de Lausanne(洛桑联邦理工学院);INRIA Saclay - Île-de-France(法国国家信息与自动化研究所萨克雷-法兰西岛分所);Université Paris-Sud(巴黎第十一大学)

Ilya Loshchilov, Marc Schoenauer, Michèle Sebag, Nikolaus Hansen

摘要:

协方差矩阵自适应演化策略(CMA-ES)是一种求解非线性、非凸优化问题的鲁棒无导数连续优化算法。众所周知,CMA-ES几乎是无参数的,这意味着只有一个超参数,即人口规模,建议由用户调整。在本文中,我们提出了一个原则性的方法称为自我CMA-ES实现在线自适应的CMA-ES超参数,以提高其整体性能。实验结果表明,当种群规模大于默认值时,CMA-ES超参数的默认设置远不是最优的,而自CMA-ES允许动态逼近最优设置.

英文摘要:

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is widely accepted as a robust derivative-free continuous optimization algorithm for non-linear and non-convex optimization problems. CMA-ES is well known to be almost parameterless, meaning that only one hyper-parameter, the population size, is proposed to be tuned by the user. In this paper, we propose a principled approach called self-CMA-ES to achieve the online adaptation of CMA-ES hyper-parameters in order to improve its overall performance. Experimental results show that for larger-than-default population size, the default settings of hyper-parameters of CMA-ES are far from being optimal, and that self-CMA-ES allows for dynamically approaching optimal settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑