arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.03473cs.NEmath.OC
收藏

带学习率自适应的CMA-ES:默认种群规模的CMA-ES能否解决多峰和噪声问题?

CMA-ES with Learning Rate Adaptation: Can CMA-ES with Default Population Size Solve Multimodal and Noisy Problems?

Masahiro Nomura, Youhei Akimoto, Isao Ono

AI总结:

为解决多峰和噪声问题,本文提出一种保持恒定信噪比的学习率自适应机制,使默认种群规模的CMA-ES无需昂贵的超参数调优即可表现良好。

摘要:

协方差矩阵自适应进化策略(CMA-ES)是求解黑盒连续优化问题最成功的方法之一。CMA-ES在实际应用中的一个有用之处是无需超参数调优即可使用。然而,超参数设置仍具有相当大的影响,特别是对于求解多峰或噪声问题等困难任务。在本研究中,我们探讨了采用默认种群规模的CMA-ES能否解决多峰和噪声问题。为此,我们为CMA-ES开发了一种新颖的学习率自适应机制,通过调整学习率来保持恒定的信噪比。我们通过数值实验研究了采用所提出的学习率自适应机制的CMA-ES的行为,并将结果与采用固定学习率的CMA-ES进行了比较。结果表明,当使用所提出的学习率自适应时,采用默认种群规模的CMA-ES在多峰和/或噪声问题上表现良好,无需极其昂贵的学习率调优。

英文摘要:

The covariance matrix adaptation evolution strategy (CMA-ES) is one of the most successful methods for solving black-box continuous optimization problems. One practically useful aspect of the CMA-ES is that it can be used without hyperparameter tuning. However, the hyperparameter settings still have a considerable impact, especially for difficult tasks such as solving multimodal or noisy problems. In this study, we investigate whether the CMA-ES with default population size can solve multimodal and noisy problems. To perform this investigation, we develop a novel learning rate adaptation mechanism for the CMA-ES, such that the learning rate is adapted so as to maintain a constant signal-to-noise ratio. We investigate the behavior of the CMA-ES with the proposed learning rate adaptation mechanism through numerical experiments, and compare the results with those obtained for the CMA-ES with a fixed learning rate. The results demonstrate that, when the proposed learning rate adaptation is used, the CMA-ES with default population size works well on multimodal and/or noisy problems, without the need for extremely expensive learning rate tuning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑