arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1608.03585stat.MLcs.LGstat.AP
收藏

热启动贝叶斯优化

Warm Starting Bayesian Optimization

Cornell University(康奈尔大学)

Matthias Poloczek, Jialei Wang, Peter I. Frazier

摘要:

我们开发了一个框架,热启动贝叶斯优化,减少了解决优化问题,这是一个相关的问题序列所需的解决时间。当优化无法提供衍生信息的随机模拟器的输出时,这是有用的,贝叶斯优化方法非常适合于此。当使用一个优化模型和在不同时间段或市场收集的输入数据做出多个业务决策时,会出现解决相关优化问题的序列。虽然许多基于梯度的方法可以通过在前一个问题的解处启动优化来热启动,但是这种热启动方法不适用于贝叶斯优化方法,贝叶斯优化方法从迭代到迭代携带目标函数的完整元模型。我们的方法建立了一个联合的统计模型的整个收集相关的目标函数,并使用一个价值的信息计算推荐点进行评估。

英文摘要:

We develop a framework for warm-starting Bayesian optimization, that reduces the solution time required to solve an optimization problem that is one in a sequence of related problems. This is useful when optimizing the output of a stochastic simulator that fails to provide derivative information, for which Bayesian optimization methods are well-suited. Solving sequences of related optimization problems arises when making several business decisions using one optimization model and input data collected over different time periods or markets. While many gradient-based methods can be warm started by initiating optimization at the solution to the previous problem, this warm start approach does not apply to Bayesian optimization methods, which carry a full metamodel of the objective function from iteration to iteration. Our approach builds a joint statistical model of the entire collection of related objective functions, and uses a value of information calculation to recommend points to evaluate.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑