arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1912.09237cs.NE
收藏

使用IOHprofiler对离散优化启发式进行基准测试

Benchmarking Discrete Optimization Heuristics with IOHprofiler

Carola Doerr, Furong Ye, Naama Horesh, Hao Wang, Ofer M. Shir, Thomas Bäck

摘要:

自动化基准测试环境旨在支持研究人员了解不同算法在不同类型的优化问题上的表现。这种比较提供了对不同方法的优点和缺点的见解,这些方法可以用于设计新算法以及算法选择和配置的自动化。最终目标是为迭代优化算法创建一个有意义的基准集,我们最近发布了IOHprofiler,这是一个用于在迭代优化算法之间创建详细性能比较的软件。通过目前的工作,我们证明了IOHprofiler为自动基准测试提供了一个合适的环境。我们编译并评估了23个离散优化问题,订阅不同类型的健身景观的选择。对于每个选定的问题,我们比较了12种不同的算法的性能,这些算法目前可作为IOHprofiler中的基线算法。我们还为IOHprofiler提供了一个新模块,它通过ECDF结果扩展各个问题的固定目标和固定预算结果,从而允许导出问题组的聚合性能统计数据。

英文摘要:

Automated benchmarking environments aim to support researchers in understanding how different algorithms perform on different types of optimization problems. Such comparisons provide insights into the strengths and weaknesses of different approaches, which can be leveraged into designing new algorithms and into the automation of algorithm selection and configuration. With the ultimate goal to create a meaningful benchmark set for iterative optimization heuristics, we have recently released IOHprofiler, a software built to create detailed performance comparisons between iterative optimization heuristics. With this present work we demonstrate that IOHprofiler provides a suitable environment for automated benchmarking. We compile and assess a selection of 23 discrete optimization problems that subscribe to different types of fitness landscapes. For each selected problem we compare performances of twelve different heuristics, which are as of now available as baseline algorithms in IOHprofiler. We also provide a new module for IOHprofiler which extents the fixed-target and fixed-budget results for the individual problems by ECDF results, which allows one to derive aggregated performance statistics for groups of problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑