arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.03532cs.LGstat.ML
收藏

基于单调信息的贝叶斯优化及其在机器学习超参数中的应用

Bayesian Optimization Using Monotonicity Information and Its Application in Machine Learning Hyperparameter

University of British Columbia(英属哥伦比亚大学)

Wenyi Wang, William J. Welch

摘要:

我们提出了一个算法的一个家庭的优化问题的目标可以分解为一个函数的单调性的总和。激励问题是优化超参数的机器学习算法,我们认为,目标,验证误差,可以分解为单调函数的超参数。我们提出的算法采用贝叶斯优化方法,将单调性约束。我们使用说明性的例子说明了利用单调性的优点,并证明了一些机器学习超参数调整应用程序的优化效率的提高。

英文摘要:

We propose an algorithm for a family of optimization problems where the objective can be decomposed as a sum of functions with monotonicity properties. The motivating problem is optimization of hyperparameters of machine learning algorithms, where we argue that the objective, validation error, can be decomposed as monotonic functions of the hyperparameters. Our proposed algorithm adapts Bayesian optimization methods to incorporate the monotonicity constraints. We illustrate the advantages of exploiting monotonicity using illustrative examples and demonstrate the improvements in optimization efficiency for some machine learning hyperparameter tuning applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑