arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.00726math.OC
收藏

基于双目标优化的批量贝叶斯全局优化采集策略

A Bi-Objective Optimization Based Acquisition Strategy for Batch Bayesian Global Optimization

Francesco Carciaghi, Simone Magistri, Pierluigi Mansueto, Fabio Schoen

AI总结:

本文提出一种基于双目标优化的批量贝叶斯优化采集策略,通过重构帕累托前沿并利用聚类选取采样点,避免了标量化带来的权衡困难,实验证明其优于现有方法。

摘要:

本文研究在盒式约束域上的批量贝叶斯优化(Bayes-Opt)问题,并提出一种新颖的双目标优化(BOO)采集策略,用于选择需要评估目标函数的采样点。该BOO问题涉及高斯过程后验均值与方差函数,在文献中的大多数采集策略中,这些函数通常被组合使用,且常通过标量化方式实现。然而,这种标量化可能损害贝叶斯优化过程的性能,因为在大多数情况下,获得探索与利用之间的理想权衡并非易事。我们转而旨在通过同时优化后验均值与方差来重构BOO问题的帕累托前沿,从而无需任何先验知识即可生成多个权衡方案。该重构通过非支配排序模因算法(NSMA)实现,该算法近期在文献中被提出,并被证明能有效解决困难的MOO问题。最后,我们提出两种聚类方法,每种方法在不同空间上操作,以从帕累托前沿中选取潜在最优的点。我们将我们的方法与文献中知名的采集策略进行比较,在广泛的实验集上展示了其有效性。

英文摘要:

In this paper, we deal with batch Bayesian Optimization (Bayes-Opt) problems over a box and we propose a novel bi-objective optimization (BOO) acquisition strategy to sample points where to evaluate the objective function. The BOO problem involves the Gaussian Process posterior mean and variance functions, which, in most of the acquisition strategies from the literature, are generally used in combination, frequently through scalarization. However, such scalarization could compromise the Bayes-Opt process performance, as getting the desired trade-off between exploration and exploitation is not trivial in most cases. We instead aim to reconstruct the Pareto front of the BOO problem based on optimizing both the posterior mean as well as the variance, thus generating multiple trade-offs without any a priori knowledge. The reconstruction is performed through the Non-dominated Sorting Memetic Algorithm (NSMA), recently proposed in the literature and proved to be effective in solving hard MOO problems. Finally, we present two clustering approaches, each of them operating on a different space, to select potentially optimal points from the Pareto front. We compare our methodology with well-known acquisition strategies from the literature, showing its effectiveness on a wide set of experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑