arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.02382stat.MLcs.LG
收藏

关于多输出高斯过程中的负迁移与潜在函数结构

On Negative Transfer and Structure of Latent Functions in Multi-output Gaussian Processes

University of Michigan(密歇根大学)

Moyan Li, Raed Kontar

AI总结:

本文在多输出高斯过程中定义了负迁移并推导了避免负迁移的必要条件,提出两种可扩展至任意大数据集的潜在函数结构,以在控制参数增长的同时避免负迁移并自动选择相关输出。

摘要:

多输出高斯过程($\mathcal{MGP}$)基于输出间存在共性的假设,然而若该假设不成立,负迁移将导致其性能相对于独立或以子集方式学习输出而有所下降。本文首先在$\mathcal{MGP}$语境下定义了负迁移,随后推导了$\mathcal{MGP}$模型避免负迁移的必要条件。具体而言,在卷积构造下,我们证明避免负迁移主要依赖于拥有足够数量的潜在函数$Q$,而不受所用核函数灵活性或推断过程的影响。然而,$Q$的微小增加会导致待估计参数数量的大幅增加。为此,我们提出了两种可扩展至任意大数据集的潜在结构,它们能避免负迁移,并允许在其中使用任意核函数或稀疏近似。这些结构还支持正则化,从而能够一致且自动地选择相关输出。

英文摘要:

The multi-output Gaussian process ($\mathcal{MGP}$) is based on the assumption that outputs share commonalities, however, if this assumption does not hold negative transfer will lead to decreased performance relative to learning outputs independently or in subsets. In this article, we first define negative transfer in the context of an $\mathcal{MGP}$ and then derive necessary conditions for an $\mathcal{MGP}$ model to avoid negative transfer. Specifically, under the convolution construction, we show that avoiding negative transfer is mainly dependent on having a sufficient number of latent functions $Q$ regardless of the flexibility of the kernel or inference procedure used. However, a slight increase in $Q$ leads to a large increase in the number of parameters to be estimated. To this end, we propose two latent structures that scale to arbitrarily large datasets, can avoid negative transfer and allow any kernel or sparse approximations to be used within. These structures also allow regularization which can provide consistent and automatic selection of related outputs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑