arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2005.10545cs.IR
收藏

ESAM:带非显示项的区分性领域自适应以提高长尾性能

ESAM: Discriminative Domain Adaptation with Non-Displayed Items to Improve Long-Tail Performance

Zhihong Chen, Rong Xiao, Chenliang Li, Gangfeng Ye, Haochuan Sun, Hongbo Deng

摘要:

大多数排名模型只使用显示项(大多数是热门项)进行训练,但它们用于检索整个空间中的项,该空间由显示项和非显示项组成(大多数是长尾项)。由于样本选择偏差,长尾项缺乏足够的记录来学习良好的特征表示,即数据稀疏和冷启动问题。由此产生的展示和非展示项目之间的分布差异将导致长尾绩效不佳。为此,我们从领域自适应(DA)的角度提出了一个全空间自适应模型(ESAM)来解决这个问题。ESAM将显示和未显示的项目分别视为源域和目标域。具体而言,我们设计了属性相关性对齐,考虑项目的高层属性之间的相关性,以实现分布对齐。此外,我们还引入了两种有效的正则化策略,即\textit{center-wise clustering}和\textit{self-training}来改进DA过程。ESAM不需要任何辅助信息和辅助域,将知识从展示项目转移到非展示项目,以减轻分布不一致性。在两个公共数据集和一个大规模的淘宝行业数据集上的实验表明,ESAM达到了最先进的性能,特别是在长尾空间。此外,我们将ESAM部署到淘宝搜索引擎,显著改善了在线性能。代码可在\url{https://github.com/A-bone1/ESAM.git}上获得

英文摘要:

Most of ranking models are trained only with displayed items (most are hot items), but they are utilized to retrieve items in the entire space which consists of both displayed and non-displayed items (most are long-tail items). Due to the sample selection bias, the long-tail items lack sufficient records to learn good feature representations, i.e. data sparsity and cold start problems. The resultant distribution discrepancy between displayed and non-displayed items would cause poor long-tail performance. To this end, we propose an entire space adaptation model (ESAM) to address this problem from the perspective of domain adaptation (DA). ESAM regards displayed and non-displayed items as source and target domains respectively. Specifically, we design the attribute correlation alignment that considers the correlation between high-level attributes of the item to achieve distribution alignment. Furthermore, we introduce two effective regularization strategies, i.e. \textit{center-wise clustering} and \textit{self-training} to improve DA process. Without requiring any auxiliary information and auxiliary domains, ESAM transfers the knowledge from displayed items to non-displayed items for alleviating the distribution inconsistency. Experiments on two public datasets and a large-scale industrial dataset collected from Taobao demonstrate that ESAM achieves state-of-the-art performance, especially in the long-tail space. Besides, we deploy ESAM to the Taobao search engine, leading to significant improvement on online performance. The code is available at \url{https://github.com/A-bone1/ESAM.git}

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑