arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1508.06802cs.NEcs.DS
收藏

引入精英黑箱模型:精英选择何时削弱进化算法的性能?

Introducing Elitist Black-Box Models: When Does Elitist Selection Weaken the Performance of Evolutionary Algorithms?

Carola Doerr, Johannes Lengler

摘要:

黑盒复杂性理论为进化算法等黑盒优化器的运行时间提供了下界,并为新的遗传算法的设计提供了灵感。存在几种涵盖不同类别算法的黑盒模型,每种模型都突出了所考虑的算法的不同方面。在这项工作中,我们添加到现有的黑盒概念一个新的\emph{elitist black-box model},其中算法需要根据所有的决定只对(固定数量的)最佳的搜索点采样到目前为止。我们的模型结合了基于排名和内存限制的黑盒模型与精英选择的功能。我们提供了几个例子,精英黑盒的复杂性是指数大于各自的复杂性在所有以前的黑盒模型,从而表明精英黑盒的复杂性可以更接近典型的进化算法的运行时间。我们还介绍了$p$的概念-蒙特卡罗黑箱复杂性,它的措施,以优化问题的失败概率最多$p$的时间。即使对于小的$p$,函数类$\mathcal F$的$p$ -蒙特卡洛黑盒复杂度也可以比其通常认为的拉斯维加斯复杂度(其测量优化$\mathcal F$所花费的\emph{expected}时间)小一个指数因子。

英文摘要:

Black-box complexity theory provides lower bounds for the runtime of black-box optimizers like evolutionary algorithms and serves as an inspiration for the design of new genetic algorithms. Several black-box models covering different classes of algorithms exist, each highlighting a different aspect of the algorithms under considerations. In this work we add to the existing black-box notions a new \emph{elitist black-box model}, in which algorithms are required to base all decisions solely on (a fixed number of) the best search points sampled so far. Our model combines features of the ranking-based and the memory-restricted black-box models with elitist selection. We provide several examples for which the elitist black-box complexity is exponentially larger than that the respective complexities in all previous black-box models, thus showing that the elitist black-box complexity can be much closer to the runtime of typical evolutionary algorithms. We also introduce the concept of $p$-Monte Carlo black-box complexity, which measures the time it takes to optimize a problem with failure probability at most $p$. Even for small~$p$, the $p$-Monte Carlo black-box complexity of a function class $\mathcal F$ can be smaller by an exponential factor than its typically regarded Las Vegas complexity (which measures the \emph{expected} time it takes to optimize $\mathcal F$).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑