arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.03789cs.NEcs.LGmath.OC
收藏

随机变量对元启发式优化算法性能的影响

Influence of Initialization on the Performance of Metaheuristic Optimizers

Xidian University(西安电子科技大学);Middlesex University(密德萨斯大学)

Qian Li, San-Yang Liu, Xin-She Yang

摘要:

所有的超启发式优化算法都需要一些初始化,并且这种优化器的初始化通常是随机进行的。然而,初始化可以有一些显着的影响,这样的算法的性能。本文系统地比较了差分进化(DE)、粒子群优化(PSO)、布谷鸟搜索(CS)、人工蜂群(ABC)算法和遗传算法(GA)等5种优化算法在22种不同初始化方法下的收敛性和精度。我们使用了19个不同的测试函数,具有不同的属性和方式来比较初始化,人口规模和迭代次数的可能影响。严格的统计排序测试表明,DE算法的函数中有43.37%的函数在不同初始化方法下表现出显著差异,而PSO和CS算法的函数中有73.68%的函数在不同初始化方法下表现出显著差异。仿真结果表明,差分进化算法对初始值不敏感,而粒子群算法和混沌进化算法对初始值敏感。此外,在函数评价(FE)的最大数目相同的条件下,种群大小也可以有很强的影响。粒子群优化通常需要较大的种群,而布谷鸟搜索只需要较小的种群规模。差分进化在很大程度上依赖于迭代次数,相对较小的种群和更多的迭代可以导致更好的结果。此外,ABC是更敏感的初始化,而这样的初始化对遗传算法的影响不大。一些概率分布,如贝塔分布,指数分布和瑞利分布通常可以导致更好的性能。本研究的意义和进一步的研究课题也进行了详细讨论。

英文摘要:

All metaheuristic optimization algorithms require some initialization, and the initialization for such optimizers is usually carried out randomly. However, initialization can have some significant influence on the performance of such algorithms. This paper presents a systematic comparison of 22 different initialization methods on the convergence and accuracy of five optimizers: differential evolution (DE), particle swarm optimization (PSO), cuckoo search (CS), artificial bee colony (ABC) algorithm and genetic algorithm (GA). We have used 19 different test functions with different properties and modalities to compare the possible effects of initialization, population sizes and the numbers of iterations. Rigorous statistical ranking tests indicate that 43.37\% of the functions using the DE algorithm show significant differences for different initialization methods, while 73.68\% of the functions using both PSO and CS algorithms are significantly affected by different initialization methods. The simulations show that DE is less sensitive to initialization, while both PSO and CS are more sensitive to initialization. In addition, under the condition of the same maximum number of function evaluations (FEs), the population size can also have a strong effect. Particle swarm optimization usually requires a larger population, while the cuckoo search needs only a small population size. Differential evolution depends more heavily on the number of iterations, a relatively small population with more iterations can lead to better results. Furthermore, ABC is more sensitive to initialization, while such initialization has little effect on GA. Some probability distributions such as the beta distribution, exponential distribution and Rayleigh distribution can usually lead to better performance. The implications of this study and further research topics are also discussed in detail.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑