arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.03953cs.NE
收藏

IOHanalyzer:迭代优化启发式算法的详细性能分析

IOHanalyzer: Detailed Performance Analyses for Iterative Optimization Heuristics

Hao Wang, Diederick Vermetten, Furong Ye, Carola Doerr, Thomas Bäck

摘要:

基准测试和性能分析在理解迭代优化算法(IOH)的行为中起着重要的作用,例如局部搜索算法,遗传和进化算法,贝叶斯优化算法等。然而,这项任务涉及手动设置,执行和分析实验,这是费力的,可以通过通用和精心设计的平台来减轻。为此,我们提出IOHanalyzer,一个新的用户友好的工具,用于分析,比较和可视化的性能数据的IOH。在R和C++中实现,IOHanalyzer是完全开源的。它可以在CRAN和GitHub上使用。IOHanalyzer提供了关于固定目标运行时间和基准算法的固定预算性能的详细统计数据,这些算法具有实值余域,单目标优化任务。在几个基准问题上的性能聚合是可能的,例如以经验累积分布函数的形式。IOHanalyzer相对于其他性能分析软件包的主要优势在于其高度交互式设计,允许用户指定对其实验最有用的性能度量、范围和粒度,并且不仅可以分析性能跟踪,还可以分析动态状态参数的演变。IOHanalyzer可以直接处理来自主要基准测试平台的性能数据,包括COCO平台,Nevergrad,SOS平台和IOHexperimenter。为用户提供了一个R编程接口,用户更喜欢对所实现的功能进行更精细的控制。

英文摘要:

Benchmarking and performance analysis play an important role in understanding the behaviour of iterative optimization heuristics (IOHs) such as local search algorithms, genetic and evolutionary algorithms, Bayesian optimization algorithms, etc. This task, however, involves manual setup, execution, and analysis of the experiment on an individual basis, which is laborious and can be mitigated by a generic and well-designed platform. For this purpose, we propose IOHanalyzer, a new user-friendly tool for the analysis, comparison, and visualization of performance data of IOHs. Implemented in R and C++, IOHanalyzer is fully open source. It is available on CRAN and GitHub. IOHanalyzer provides detailed statistics about fixed-target running times and about fixed-budget performance of the benchmarked algorithms with a real-valued codomain, single-objective optimization tasks. Performance aggregation over several benchmark problems is possible, for example in the form of empirical cumulative distribution functions. Key advantages of IOHanalyzer over other performance analysis packages are its highly interactive design, which allows users to specify the performance measures, ranges, and granularity that are most useful for their experiments, and the possibility to analyze not only performance traces, but also the evolution of dynamic state parameters. IOHanalyzer can directly process performance data from the main benchmarking platforms, including the COCO platform, Nevergrad, the SOS platform, and IOHexperimenter. An R programming interface is provided for users preferring to have a finer control over the implemented functionalities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑