arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2005.04088cs.LGstat.ML
收藏

线性回归的自动跨域迁移学习

Automatic Cross-Domain Transfer Learning for Linear Regression

Vivo Software Co. LTD(维沃软件有限公司)

Xinshun Liu, He Xin, Mao Hui, Liu Jing, Lai Weizhong, Ye Qingwen

AI总结:

本文针对领域信息未知的线性回归迁移学习问题,提出基于狄利克雷过程推断潜在领域,并同时迁移解释变量与响应变量,通过联合分布建模有效控制偏差,在真实数据集上验证了模型效果。

摘要:

迁移学习研究试图使模型归纳能够跨不同领域进行迁移。该方法假设每个实例所属领域的具体信息是已知的。本文有助于将线性回归问题的迁移学习能力扩展到领域信息不确定或未知的情况;事实上,该框架可以扩展到分类问题。对于常规数据集,我们假设存在一些潜在的领域信息可用于迁移学习。每个领域中的实例可以通过不同的参数来推断。我们基于狄利克雷过程,从解释变量$x$和响应变量$y$对应的回归系数分布中获取这些领域信息,这更为合理。因此,我们不仅像通常那样迁移变量$x$,还迁移变量$y$,这是具有挑战性的,因为测试数据没有响应值。先前的工作主要通过基于直推学习的伪标签来克服这一问题,但这会引入严重的偏差。我们提供了一个新颖的框架来分析该问题并考虑这种一般情况:变量$x$和变量$y$的联合分布。此外,与先前的工作相比,我们的方法能更好地控制偏差。我们在由不同潜在领域和目标领域(来自测试数据)组成的新特征空间上执行线性回归。实验结果表明,所提出的模型在真实数据集上表现良好。

英文摘要:

Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the capability of transfer learning for linear regression problems to situations where the domain information is uncertain or unknown; in fact, the framework can be extended to classification problems. For normal datasets, we assume that some latent domain information is available for transfer learning. The instances in each domain can be inferred by different parameters. We obtain this domain information from the distribution of the regression coefficients corresponding to the explanatory variable $x$ as well as the response variable $y$ based on a Dirichlet process, which is more reasonable. As a result, we transfer not only variable $x$ as usual but also variable $y$, which is challenging since the testing data have no response value. Previous work mainly overcomes the problem via pseudo-labelling based on transductive learning, which introduces serious bias. We provide a novel framework for analysing the problem and considering this general situation: the joint distribution of variable $x$ and variable $y$. Furthermore, our method controls the bias well compared with previous work. We perform linear regression on the new feature space that consists of different latent domains and the target domain, which is from the testing data. The experimental results show that the proposed model performs well on real datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑