arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.02474cs.IRcs.AI
收藏

Q-BERT4Rec: 量化语义-ID表示学习用于多模态推荐

Q-BERT4Rec: Quantized Semantic-ID Representation Learning for Multimodal Recommendation

University of Shanghai for Science and Technology(上海科学技术大学)

Haofeng Huang, Ling Gai

AI总结:

Q-BERT4Rec通过统一语义表示与量化建模,提升多模态推荐的性能和可解释性。

摘要:

顺序推荐在电子商务、广告和内容流媒体等现代在线平台中起着关键作用,准确预测用户下一步交互对于个性化至关重要。最近基于Transformer的方法如BERT4Rec展示了强大的建模能力,但它们仍然依赖于缺乏语义意义的离散项目ID,并且忽略了丰富的多模态信息(例如文本和图像)。这导致了泛化能力差和可解释性有限。为了解决这些挑战,我们提出了Q-Bert4Rec,一个多模态顺序推荐框架,统一了语义表示和量化建模。具体而言,Q-Bert4Rec包含三个阶段:(1)跨模态语义注入,通过动态Transformer将随机初始化的ID嵌入通过文本、视觉和结构特征融合来丰富;(2)语义量化,通过残差向量量化将融合的表示离散化为有意义的标记;(3)多掩码预训练和微调,利用多样化的掩码策略——跨度、尾部和多区域——来提高顺序理解。我们在公共亚马逊基准上验证了我们的模型,并证明Q-Bert4Rec显著优于许多强大的现有方法,证实了语义标记化在多模态顺序推荐中的有效性。我们的源代码将在发布后在GitHub上公开。

英文摘要:

Sequential recommendation plays a critical role in modern online platforms such as e-commerce, advertising, and content streaming, where accurately predicting users' next interactions is essential for personalization. Recent Transformer-based methods like BERT4Rec have shown strong modeling capability, yet they still rely on discrete item IDs that lack semantic meaning and ignore rich multimodal information (e.g., text and image). This leads to weak generalization and limited interpretability. To address these challenges, we propose Q-Bert4Rec, a multimodal sequential recommendation framework that unifies semantic representation and quantized modeling. Specifically, Q-Bert4Rec consists of three stages: (1) cross-modal semantic injection, which enriches randomly initialized ID embeddings through a dynamic transformer that fuses textual, visual, and structural features; (2) semantic quantization, which discretizes fused representations into meaningful tokens via residual vector quantization; and (3) multi-mask pretraining and fine-tuning, which leverage diverse masking strategies -- span, tail, and multi-region -- to improve sequential understanding. We validate our model on public Amazon benchmarks and demonstrate that Q-Bert4Rec significantly outperforms many strong existing methods, confirming the effectiveness of semantic tokenization for multimodal sequential recommendation. Our source code will be publicly available on GitHub after publishing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑