The success of kernel-based learning methods depend on the choice of kernel. Recently, kernel learning methods have been proposed that use data to select the most appropriate kernel, usually by combining a set of base kernels. We introduce a new algorithm for kernel learning that combines a {\em continuous set of base kernels}, without the common step of discretizing the space of base kernels. We demonstrate that our new method achieves state-of-the-art performance across a variety of real-world datasets. Furthermore, we explicitly demonstrate the importance of combining the right dictionary of kernels, which is problematic for methods based on a finite set of base kernels chosen a priori. Our method is not the first approach to work with continuously parameterized kernels. However, we show that our method requires substantially less computation than previous such approaches, and so is more amenable to multiple dimensional parameterizations of base kernels, which we demonstrate.
Kernel Alignment for Unsupervised Transfer Learning
Laboratoire Hubert Curien, CNRS (UMR 5516) Universit\'e Jean Monnet F-42000, Saint-Etienne, France Email;Laboratoire d'Informatique de Paris-Nord, CNRS (UMR 7030) Universit\'e Paris 13, Sorbonne Paris Cit\'e F-93430, Villetaneuse, France Email
A Mean-Field Theory for Kernel Alignment with Random Features in Generative and Discriminative Models
Department of Management Science, Stanford University(斯坦福大学管理科学系);Department of Electrical Engineering, Stanford University(斯坦福大学电气工程系);Department of Radiation Oncology, Stanford University(斯坦福大学放射肿瘤学系);Department of Industrial Engineering, Texas A&M University(得克萨斯农工大学工业工程系)
Space-efficient Feature Maps for String Alignment Kernels
RIKEN Center for Advanced Intelligence Project(理化学研究所先进智能项目中心);Kyushu Institute of Technology(九州工业大学);BARC(BARC(哥本哈根基础算法研究中心));IT University of Copenhagen(哥本哈根信息技术大学)
UniCon: Unified Framework for Efficient Contrastive Alignment via Kernels
Department of Electrical & Computer Engineering, The Grainger College of Engineering, UIUC(电气与计算机工程系,格拉inger工程学院,伊利诺伊大学香槟分校);Siebel School of Computing and Data Science, The Grainger College of Engineering, UIUC(计算与数据科学学院,格拉inger工程学院,伊利诺伊大学香槟分校);Coordinated Science Laboratory, University of Illinois Urbana-Champaign (UIUC)(协调科学实验室,伊利诺伊大学香槟分校);VinUni-Illinois Smart Health Center(VinUni-伊利诺伊智能健康中心)
Efficient Parameter Optimisation for Quantum Kernel Alignment: A Sub-sampling Approach in Variational Training
The Hartree Centre, STFC(哈特雷中心(科学技术设施委员会));IBM Research – Zurich(IBM研究院苏黎世分部);University of Warwick(华威大学);IBM Research Europe - UK(IBM研究院欧洲英国分部);National Heart and Lung Institute, Imperial College London(帝国理工学院国家心肺研究所)
Spectral Bias and Task-Model Alignment Explain Generalization in Kernel Regression and Infinitely Wide Neural Networks
Department of Physics, Harvard University(哈佛大学物理系);Center for Brain Science, Harvard University(哈佛大学脑科学中心);John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院)
A decoupled alignment kernel for peptide membrane permeability predictions
Center for Applied Intelligent Systems Research in Health(应用智能系统研究健康中心);Halmstad University(哈姆斯塔德大学);Chalmers University of Technology(查尔姆斯理工大学);AstraZeneca(阿斯利康);Region Halland(哈兰德地区);Lund University(吕勒欧大学)
Quasiparticle Interference Kernel Extraction with Variational Autoencoders via Latent Alignment
Department of Computer Science \& \ University of Notre Dame South Bend, IN, USA;Department of Physics \& Astronomy University of Notre Dame South Bend, IN, USA
Alignment-Sensitive Minimax Rates for Spectral Algorithms with Learned Kernels
Department of Statistics and Data Science, National University of Singapore, Singapore(新加坡国立大学统计与数据科学系);School of Statistics and Mathematics, Zhongnan University of Economics and Law, Wuhan, China(中南财经政法大学统计与数学学院);Department of Statistics and Data Science, Tsinghua University, Beijing, China(清华大学统计与数据科学系)
Joint Laboratory of Data Science and Business Intelligence, School of Statistics and Data Science, Southwestern University of Finance and Economics(数据科学与商业智能联合实验室,统计与数据科学学院,西南财经大学);Department of Electrical Engineering and Computer Science, University of Kansas(电气与计算机工程系,堪萨斯大学);School of Computing and Artificial Intelligence, Southwest Jiaotong University(计算与人工智能学院,西南交通大学)