arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2111.05040math.OC
收藏

高维高斯过程建模及其在贝叶斯optimization中的应用

A survey on high-dimensional Gaussian process modeling with application to Bayesian optimization

Mickael Binois, Nathan Wycoff

摘要:

贝叶斯优化,贝叶斯函数逼近的应用,以寻找最优的昂贵的功能,近年来爆炸式的流行。特别是,人们已经注意到,以提高其效率的问题,许多参数优化。这种关注已经渗透到高维BO的主力,高维高斯过程回归,这也是独立的利益。高斯过程先验隐含的巨大灵活性在建模复杂的低维表面时是一个福音,但当维度变得太大时,它说得太少了。已经测试了各种结构模型假设来驯服高维,从变量选择和加法分解到低维嵌入等等。大多数这些方法反过来也需要修改采集函数优化策略。在这里,我们回顾定义结构模型的假设,并讨论这些方法在实践中的优点和缺点。

英文摘要:

Bayesian Optimization, the application of Bayesian function approximation to finding optima of expensive functions, has exploded in popularity in recent years. In particular, much attention has been paid to improving its efficiency on problems with many parameters to optimize. This attention has trickled down to the workhorse of high dimensional BO, high dimensional Gaussian process regression, which is also of independent interest. The great flexibility that the Gaussian process prior implies is a boon when modeling complicated, low dimensional surfaces but simply says too little when dimension grows too large. A variety of structural model assumptions have been tested to tame high dimensions, from variable selection and additive decomposition to low dimensional embeddings and beyond. Most of these approaches in turn require modifications of the acquisition function optimization strategy as well. Here we review the defining structural model assumptions and discuss the benefits and drawbacks of these approaches in practice.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑