arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1802.05400stat.ML
收藏

基于Dropout的高维贝叶斯优化

High Dimensional Bayesian Optimization Using Dropout

Cheng Li, Sunil Gupta, Santu Rana, Vu Nguyen, Svetha Venkatesh, Alistair Shilton

摘要:

将贝叶斯优化扩展到高维是一项具有挑战性的任务,因为高维获取函数的全局优化可能成本高昂且通常不可行。现有的方法依赖于有限的活动变量或目标函数的加法形式。提出了一种新的高维贝叶斯优化方法,该方法在每次迭代中只优化一个变量子集。我们推导出理论界的遗憾,并显示它如何可以通知我们的算法的推导。我们证明了我们的算法优化的两个基准函数和两个现实世界的应用程序-训练级联分类器和优化合金成分的功效。

英文摘要:

Scaling Bayesian optimization to high dimensions is challenging task as the global optimization of high-dimensional acquisition function can be expensive and often infeasible. Existing methods depend either on limited active variables or the additive form of the objective function. We propose a new method for high-dimensional Bayesian optimization, that uses a dropout strategy to optimize only a subset of variables at each iteration. We derive theoretical bounds for the regret and show how it can inform the derivation of our algorithm. We demonstrate the efficacy of our algorithms for optimization on two benchmark functions and two real-world applications- training cascade classifiers and optimizing alloy composition.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑