We present a principled study on defining Gaussian processes (GPs) with inputs on the product of directional manifolds. A circular kernel is first presented according to the von Mises distribution. Based thereon, the hypertoroidal von Mises (HvM) kernel is proposed to establish GPs on hypertori with consideration of correlated circular components. The proposed HvM kernel is demonstrated with multi-output GP regression for learning vector-valued functions on hypertori using the intrinsic coregionalization model. Analytic derivatives for hyperparameter optimization are provided for runtime-critical applications. For evaluation, we synthesize a ranging-based sensor network and employ the HvM-based GPs for data-driven recursive localization. Numerical results show that the HvM-based GP achieves superior tracking accuracy compared to parametric model and GPs of conventional kernel designs.
Intrinsic Gaussian Process Regression Modeling for Manifold-valued Response Variable
International Institute of Finance, School of Management, University of Science and Technology of China(中国科学技术大学管理学院国际金融学院);Department of Statistics and Data Science, College of Science, Southern University of Science and Technology(南方科技大学理学院统计与数据科学系)
Vector-valued Gaussian Processes on Riemannian Manifolds via Gauge Independent Projected Kernels
University of Oxford(牛津大学);University College London(伦敦大学学院);University of Cambridge(剑桥大学);Imperial College London(帝国理工学院);St. Petersburg State University(圣彼得堡国立大学)
Department of Statistical Science Duke University, Durham, NC(统计科学系杜克大学);Department of Mathematical Sciences The University of Texas at Dallas, Richardson, TX(数学科学系德克萨斯大学达拉斯分校)
Active Learning for Manifold Gaussian Process Regression
Dept. of Applied Mathematics(应用数学系);Illinois Institute of Technology(伊利诺伊理工学院);Dept. of Mathematics and Statistics(数学与统计学系);University of Massachusetts Amherst(马萨诸塞大学阿姆赫斯特分校);Dept. of Mathematics(数学系);University of California Riverside(加州大学河滨分校)
St. Petersburg State University(圣彼得堡国立大学);Imperial College London(伦敦帝国理工学院);University College London(伦敦大学学院);St. Petersburg Department of Steklov Mathematical Institute of Russian Academy of Sciences(俄罗斯科学院斯捷克洛夫数学研究所圣彼得堡分所)
Technische Universität Darmstadt(达姆施塔特工业大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);University of Cambridge(剑桥大学);Imperial College London(帝国理工学院)
AdaDGS: An adaptive black-box optimization method with a nonlocal directional Gaussian smoothing gradient
Oak Ridge National Laboratory(橡树岭国家实验室)
局部梯度指向无穷小邻域中最陡斜率的方向。当损失是多模态的时,由局部梯度引导的优化器经常陷入局部最优。最近在(Zhang et al.,2020),并用于定义一个真正的非局部梯度,称为DGS梯度,用于高维黑盒优化。有希望的结果表明,取代传统的局部梯度与DGS梯度可以显着提高基于梯度的方法在优化高度多模态损失函数的性能。然而,DGS梯度的最佳性能可能依赖于两个重要超参数的微调,即,平滑半径和学习率。在本文中,我们提出了一个简单的,但巧妙的和有效的自适应方法与DGS梯度优化,消除了超参数微调的需要。由于DGS梯度通常指向良好的搜索方向,因此我们沿着DGS方向执行线搜索以确定每次迭代的步长。学习的步长反过来会告诉我们周围区域中函数景观的规模,基于此,我们相应地调整平滑半径以进行下一次迭代。我们提出了高维基准函数,翼型设计问题和游戏内容生成问题的实验结果。AdaDGS方法已经显示出优于几种最先进的黑盒优化方法的性能。
Distance Measure Based on an Embedding of the Manifold of K-Component Gaussian Mixture Models into the Manifold of Symmetric Positive Definite Matrices
Indian Institute of Space Science and Technology(印度空间科学与技术学院)
Wrapped Gaussian on the manifold of Symmetric Positive Definite Matrices
LAMSADE, CNRS, PSL Univ. Paris-Dauphine, France(巴黎-萨克雷大学巴黎-达菲学院、国家科学研究中心、巴黎-达菲大学);Inria center at the University of Bordeaux / LaBRI, France(波尔多大学/LaBRI与Inria中心);TAU, LISN, University Paris-Saclay, France(巴黎-萨克雷大学、LISN、TAU)