arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2302.05031cs.IRcs.AI
收藏

减少负迁移的特征分解:一种新的推荐系统多任务学习方法

Feature Decomposition for Reducing Negative Transfer: A Novel Multi-task Learning Method for Recommender System

School of Software, Beihang University(北京航空航天大学软件学院)

Jie Zhou, Qian Yu, Chuan Luo, Jing Zhang

摘要:

近年来,由于深度学习(DL)的快速发展,基于DL的多任务学习(MTL)取得了重大进展,并成功应用于推荐系统(RS)。然而,在推荐系统中,所涉及的任务之间的相关性是复杂的。因此,现有的为RS设计的MTL模型都存在不同程度的负迁移现象,不利于MTL的优化。我们发现,负迁移的根本原因是特征冗余,即为不同任务学习的特征相互干扰。为了缓解负迁移问题,我们提出了一种新的多任务学习方法,称为特征分解网络(FDN)。FDN的核心思想是通过明确地将特征分解为特定于任务的特征和具有精心设计的约束的任务共享特征来减少特征冗余现象。我们在两个数据集上证明了所提出的方法的有效性,一个合成数据集和一个公共数据集(即,Ali-CCP)。实验结果表明,我们提出的FDN可以优于国家的最先进的(SOTA)方法的一个显着的利润。

英文摘要:

In recent years, thanks to the rapid development of deep learning (DL), DL-based multi-task learning (MTL) has made significant progress, and it has been successfully applied to recommendation systems (RS). However, in a recommender system, the correlations among the involved tasks are complex. Therefore, the existing MTL models designed for RS suffer from negative transfer to different degrees, which will injure optimization in MTL. We find that the root cause of negative transfer is feature redundancy that features learned for different tasks interfere with each other. To alleviate the issue of negative transfer, we propose a novel multi-task learning method termed Feature Decomposition Network (FDN). The key idea of the proposed FDN is reducing the phenomenon of feature redundancy by explicitly decomposing features into task-specific features and task-shared features with carefully designed constraints. We demonstrate the effectiveness of the proposed method on two datasets, a synthetic dataset and a public datasets (i.e., Ali-CCP). Experimental results show that our proposed FDN can outperform the state-of-the-art (SOTA) methods by a noticeable margin.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑