arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.06510stat.MLcs.LGstat.CO
收藏

高斯过程对核选择的鲁棒性度量

Measuring the robustness of Gaussian processes to kernel choice

MIT(麻省理工学院);MIT-IBM Watson AI Lab(麻省理工学院-IBM沃森人工智能实验室);IBM Research(IBM研究院)

William T. Stephenson, Soumya Ghosh, Tin D. Nguyen, Mikhail Yurochkin, Sameer K. Deshpande, Tamara Broderick

摘要:

高斯过程(GP)用于做出医疗和科学决策,包括心脏护理和监测大气二氧化碳水平。值得注意的是,GP内核的选择通常有些随意。特别地,不可数的许多内核通常与定性先验知识(例如,函数平滑性或平稳性)。但在实践中,数据分析师会在少数方便的标准内核中进行选择(例如\平方指数)。在目前的工作中,我们问:将决定与GP不同的其他,定性可互换的内核?我们将展示如何通过解决有限维空间上的约束优化问题来回答这个问题。然后,我们可以使用标准优化器来识别GP做出的相关决策中的实质性变化。我们证明在合成和现实世界的例子中,与GP的决定可以表现出非鲁棒性内核的选择,即使以前的提请是定性互换给用户。

英文摘要:

Gaussian processes (GPs) are used to make medical and scientific decisions, including in cardiac care and monitoring of atmospheric carbon dioxide levels. Notably, the choice of GP kernel is often somewhat arbitrary. In particular, uncountably many kernels typically align with qualitative prior knowledge (e.g.\ function smoothness or stationarity). But in practice, data analysts choose among a handful of convenient standard kernels (e.g.\ squared exponential). In the present work, we ask: Would decisions made with a GP differ under other, qualitatively interchangeable kernels? We show how to answer this question by solving a constrained optimization problem over a finite-dimensional space. We can then use standard optimizers to identify substantive changes in relevant decisions made with a GP. We demonstrate in both synthetic and real-world examples that decisions made with a GP can exhibit non-robustness to kernel choice, even when prior draws are qualitatively interchangeable to a user.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑