arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1901.08098stat.MLcs.LG
收藏

高斯过程的元学习均值函数

Meta-Learning Mean Functions for Gaussian Processes

ETH Zürich(苏黎世联邦理工学院);Deepmind(深度思维)

Vincent Fortuin, Heiko Strathmann, Gunnar Rätsch

摘要:

当在稀缺数据上拟合贝叶斯机器学习模型时,主要挑战是获得合适的先验知识并将其编码到模型中。元学习的最新进展为从相关任务中获取的数据中提取这种先验知识提供了强大的方法。当涉及到高斯过程模型中的元学习时,这种设置中的方法主要集中在学习先验的核函数,而不是学习其均值函数。在这项工作中,我们探索了对高斯过程先验均值函数的元学习。我们提出了分析和经验证据,表明均值函数学习在元学习环境中是有用的,讨论了过拟合的风险,并与其他元学习方法(如模型不可知元学习和功能PCA)建立了联系。

英文摘要:

When fitting Bayesian machine learning models on scarce data, the main challenge is to obtain suitable prior knowledge and encode it into the model. Recent advances in meta-learning offer powerful methods for extracting such prior knowledge from data acquired in related tasks. When it comes to meta-learning in Gaussian process models, approaches in this setting have mostly focused on learning the kernel function of the prior, but not on learning its mean function. In this work, we explore meta-learning the mean function of a Gaussian process prior. We present analytical and empirical evidence that mean function learning can be useful in the meta-learning setting, discuss the risk of overfitting, and draw connections to other meta-learning approaches, such as model agnostic meta-learning and functional PCA.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑