arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.08758cs.IR
收藏

利用上下文感知特征表示学习增强CTR预测

Enhancing CTR Prediction with Context-Aware Feature Representation Learning

Fangye Wang, Yingxu Wang, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Ning Gu

摘要:

CTR预测在现实世界中得到了广泛的应用。许多方法对特征交互进行建模以提高其性能。然而,大多数方法只学习每个特征的固定表示,而不考虑每个特征在不同上下文下的不同重要性,导致性能较差。最近,有几种方法试图学习特征表示的向量级权重,以解决固定表示问题。然而,它们只产生线性变换来细化固定的特征表示,这仍然不够灵活,无法捕捉不同上下文下每个特征的不同重要性。在本文中,我们提出了一个新的模块命名为特征细化网络(FRNet),它学习上下文感知的特征表示在比特级的每个功能在不同的上下文中。FRNet由两个关键组件组成:1)信息抽取单元(IEU),它捕获上下文信息和跨特征关系,以指导上下文感知的特征细化; 2)互补选择门(CSGate),它自适应地将IEU中学习的原始和互补特征表示与位级权重相结合。值得注意的是,FRNet与现有的CTR方法正交,因此可以应用于许多现有的方法以提高其性能。综合实验验证了FRNet的有效性、效率和兼容性。

英文摘要:

CTR prediction has been widely used in the real world. Many methods model feature interaction to improve their performance. However, most methods only learn a fixed representation for each feature without considering the varying importance of each feature under different contexts, resulting in inferior performance. Recently, several methods tried to learn vector-level weights for feature representations to address the fixed representation issue. However, they only produce linear transformations to refine the fixed feature representations, which are still not flexible enough to capture the varying importance of each feature under different contexts. In this paper, we propose a novel module named Feature Refinement Network (FRNet), which learns context-aware feature representations at bit-level for each feature in different contexts. FRNet consists of two key components: 1) Information Extraction Unit (IEU), which captures contextual information and cross-feature relationships to guide context-aware feature refinement; and 2) Complementary Selection Gate (CSGate), which adaptively integrates the original and complementary feature representations learned in IEU with bit-level weights. Notably, FRNet is orthogonal to existing CTR methods and thus can be applied in many existing methods to boost their performance. Comprehensive experiments are conducted to verify the effectiveness, efficiency, and compatibility of FRNet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑