arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.09793cs.LG
收藏

信息几何下的概率单纯形贝叶斯优化

Information Theoretic Bayesian Optimization over the Probability Simplex

Department of Economics, Management and Statistics University of Milan, Bicocca(经济管理统计系米兰大学Bicocca分校);Department of Robotics, Perception and Learning KTH Royal Institute of Technology(机器人感知与学习系皇家理工学院KTH);University of Milan, Bicocca Milan, Italy(米兰大学Bicocca分校);KTH Royal Institute of Technology Stockholm, Sweden(皇家理工学院KTH 斯德哥尔摩瑞典)

Federico Pavesi, Antonio Candelieri, Noémie Jaquier

AI总结:

本文提出了一种基于信息几何的概率单纯形贝叶斯优化算法,通过构建几何优化器和马尔可夫核,在概率约束域中提升优化性能。

摘要:

贝叶斯优化是一种数据高效的技巧,已被证明在优化昂贵、黑箱且可能噪声的目标函数时非常强大。许多应用涉及优化概率和混合物,这些自然属于概率单纯形,这是一个由非负条目求和为一的约束非欧几里得域定义的领域。本文介绍了α-GaBO,一种新的在概率单纯形上进行贝叶斯优化的算法家族。我们的方法基于信息几何,这是黎曼几何的一个分支,它为单纯形赋予了黎曼度量和一类连接。基于信息几何理论,我们构建了反映概率单纯形几何的马尔可夫核,以及一个参数化的几何优化器用于获取函数。我们在基准函数和各种现实应用中验证了我们的方法,包括组件混合、分类器混合和机器人控制任务,显示了其相比约束欧几里得方法的提升性能。

英文摘要:

Bayesian optimization is a data-efficient technique that has been shown to be extremely powerful to optimize expensive, black-box, and possibly noisy objective functions. Many applications involve optimizing probabilities and mixtures which naturally belong to the probability simplex, a constrained non-Euclidean domain defined by non-negative entries summing to one. This paper introduces $α$-GaBO, a novel family of Bayesian optimization algorithms over the probability simplex. Our approach is grounded in information geometry, a branch of Riemannian geometry which endows the simplex with a Riemannian metric and a class of connections. Based on information geometry theory, we construct Matérn kernels that reflect the geometry of the probability simplex, as well as a one-parameter family of geometric optimizers for the acquisition function. We validate our method on benchmark functions and on a variety of real-world applications including mixtures of components, mixtures of classifiers, and a robotic control task, showing its increased performance compared to constrained Euclidean approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑