Gaussian processes (GPs) are used to make medical and scientific decisions, including in cardiac care and monitoring of atmospheric carbon dioxide levels. Notably, the choice of GP kernel is often somewhat arbitrary. In particular, uncountably many kernels typically align with qualitative prior knowledge (e.g.\ function smoothness or stationarity). But in practice, data analysts choose among a handful of convenient standard kernels (e.g.\ squared exponential). In the present work, we ask: Would decisions made with a GP differ under other, qualitatively interchangeable kernels? We show how to answer this question by solving a constrained optimization problem over a finite-dimensional space. We can then use standard optimizers to identify substantive changes in relevant decisions made with a GP. We demonstrate in both synthetic and real-world examples that decisions made with a GP can exhibit non-robustness to kernel choice, even when prior draws are qualitatively interchangeable to a user.
Measuring IIA Violations in Similarity Choices with Bayesian Models
Department of Computer and Systems Engineering(计算机与系统工程系);Federal University of Rio de Janeiro (UFRJ)(里约热内卢联邦大学);School of Computer and Communication Sciences(计算机与通信科学学院);Ecole Polytechnique Fédérale de Lausanne (EPFL)(洛桑联邦理工学院)
Measuring Negotiation Traits with Collaborative Choice Data: A Two-Stage Latent Variable Model
London School of Economics and Political Science(伦敦政治经济学院);Educational Testing Service(美国教育考试服务中心);Collaborative Innovation Center of Assessment for Basic Education Quality, Beijing Normal University(北京师范大学基础教育质量协同创新中心)
Optimal Kernel Choice for Score Function-based Causal Discovery
The University of Melbourne(墨尔本大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of California, San Diego(加州大学圣迭戈分校);Huazhong University of Science and Technology(华中科技大学);The University of Sydney(悉尼大学);Carnegie Mellon University(卡内基梅隆大学)
Jarzynski Reweighting and Sampling Dynamics for Training Energy-Based Models: Theoretical Analysis of Different Transition Kernels
Dipartimento di Scienze Matematiche, Politecnico di Torino, Italy(都灵理工大学数学科学系);Istituto Nazionale di Fisica Nucleare, Sezione di Torino, Italy(意大利国家核物理研究所都灵分部);Laboratoire de Physique de l’École normale supérieure, ENS, Université PSL, France(法国高等科学研究所物理实验室)
A Variational Analysis of Kernel Learning with Learnable Linear Transformations
Cambridge University, Department of Pure Mathematics and Mathematical Statistics(剑桥大学数学系);Northwestern University, Department of Statistics and Data Science(西北大学统计与数据科学系)