量化意图:基于有机活动的跨域语义ID用于工业排序
Quantizing Intent: Cross-Domain Semantic IDs from Organic Activity for Industrial Ranking
AI总结:
提出从有机feed活动中提取跨域用户语义ID,并通过残差有限标量量化方法(RQ-FSQ)离散化预训练嵌入,在显著降低存储的同时匹配或超越密集嵌入的AUC,有效提升广告点击率预测中稀疏用户监督的跨域迁移效果。
摘要:
广告点击率(CTR)预测受到稀疏用户监督的限制:大多数用户很少与广告互动,而在有机界面(如feed)中产生密集的行为证据。由于领域不匹配、服务成本和生产复杂性,将这些跨域信号转移到广告排序中很困难。我们引入了从有机feed活动派生的跨域用户语义ID(SID),并表明行为活动丰富度主导了跨域迁移质量:来自用户画像文本的SID带来+0.036% AUC,来自基于活动调优的LLaMA用户嵌入模型的SID带来+0.107%,而来自直接feed活动行为嵌入的SID带来+0.213%。我们进一步提出了RQ-FSQ,一种残差有限标量量化方法,在显著减小存储的同时离散化预训练嵌入,并匹配密集嵌入的AUC。在两个异构源上,RQ-FSQ匹配或略微超过密集源嵌入,在约30倍存储缩减下实现Feed Activity的+0.351% AUC,在约280倍存储缩减下实现Activity-Tuned LLaMA的+0.265% AUC。我们还引入了一个层次化离散嵌入模块,通过前缀n-gram稀疏嵌入表编码多级SID,并在CTR目标下进行端到端训练。在一个大规模工业广告排序系统中,冷启动段分析显示,对于广告交互历史近乎为零的用户,增益高达+1.522%,验证了跨域行为迁移作为稀疏历史排序的有效桥梁。
英文摘要:
Ads click-through rate (CTR) prediction is constrained by sparse user supervision: most users engage with ads infrequently while generating dense behavioral evidence in organic surfaces such as feed. Transferring these cross-domain signals into ads ranking is difficult due to domain mismatch, serving cost, and production complexity. We introduce cross-domain user Semantic IDs (SIDs) derived from organic feed activity and show that behavioral activity richness governs cross-domain transfer quality: SIDs from user profile text yield +0.036% AUC, SIDs from an activity-tuned LLaMA-based user embedding model yield +0.107%, and SIDs from direct feed activity behavioral embeddings yield +0.213%. We further propose RQ-FSQ, a residual finite scalar quantization method that discretizes pre-trained embeddings while matching dense-embedding AUC at substantially smaller storage. Across two heterogeneous sources, RQ-FSQ matches or slightly exceeds dense source embeddings, achieving +0.351% AUC for Feed Activity at about 30x smaller storage and +0.265% AUC for Activity-Tuned LLaMA at about 280x smaller storage. We also introduce a Hierarchical Discrete Embedding module that encodes multi-level SIDs through prefix n-gram sparse embedding tables trained end-to-end under the CTR objective. In a large-scale industrial ads ranking system, cold-start segment analysis shows gains up to +1.522% for users with near-zero ad interaction history, validating cross-domain behavioral transfer as an effective bridge for sparse-history ranking.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。