arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.13140math.OC
收藏

带价值函数的约束贝叶斯优化

Constrained Bayesian optimization with merit functions

J. Wang, C. G. Petra, J. L. Peterson

AI总结:

针对约束贝叶斯优化中现存障碍,提出基于价值函数的采集函数设计,提升效率并允许不可行初始样本,通过数值与工程实验验证其有效性。

摘要:

贝叶斯优化是一种强大的优化工具,适用于原生一阶导数不可用的问题。近年来,约束贝叶斯优化(CBO)已被应用于许多约束至关重要的工程应用。然而,当前的CBO算法仍存在一些障碍,可能阻碍其更广泛的采用。我们提出了使用价值函数(如惩罚价值函数)的CBO算法,将其用于采集函数中,灵感来自非线性优化方法,例如序列二次规划。价值函数衡量目标和约束函数的潜在进展,从而提高算法效率并允许不可行的初始样本。带有价值函数的采集函数被放宽为具有封闭形式,使其实现可在任何贝叶斯优化可用的地方直接使用。我们进一步提出了一种统一的CBO算法,可视为流行的期望约束改进(ECI)方法的扩展。我们通过合成问题上的数值实验以及等离子体物理领域的实际数据驱动工程设计问题,展示了所提出算法的有效性和效率。

英文摘要:

Bayesian optimization is a powerful optimization tool for problems where native first-order derivatives are unavailable. Recently, constrained Bayesian optimization (CBO) has been applied to many engineering applications where constraints are essential. However, several obstacles remain with current CBO algorithms that could prevent a wider adoption. We propose CBO algorithms using merit functions, such as the penalty merit function, in acquisition functions, inspired by nonlinear optimization methods, e.g., sequential quadratic programming. Merit functions measure the potential progress of both the objective and constraint functions, thus increasing algorithmic efficiency and allowing infeasible initial samples. The acquisition functions with merit functions are relaxed to have closed forms, making its implementation readily available wherever Bayesian optimization is. We further propose a unified CBO algorithm that can be seen as extension to the popular expected constrained improvement (ECI) approach. We demonstrate the effectiveness and efficiency of the proposed algorithms through numerical experiments on synthetic problems and a practical data-driven engineering design problem in the field of plasma physics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑