DiffCL:一种用于多模态推荐的基于扩散的对比学习框架与语义对齐
DiffCL: A Diffusion-Based Contrastive Learning Framework with Semantic Alignment for Multimodal Recommendations
AI总结:
本文提出DiffCL框架,通过扩散模型生成对比视图降噪、利用稳定ID嵌入对齐跨模态语义,并引入物品-物品图缓解数据稀疏问题,在多模态推荐中取得更优效果。
摘要:
多模态推荐系统将多样化的多模态信息整合到物品和用户的特征表示中,从而能够更全面地建模用户偏好。然而,现有方法受到数据稀疏性和多模态数据中固有噪声的阻碍,这妨碍了对用户兴趣偏好的准确捕捉。此外,不同模态之间物品语义表示的差异会对推荐模型的预测准确性产生不利影响。为了解决这些挑战,我们提出了一种新颖的基于扩散的对比学习框架(DiffCL),用于多模态推荐。DiffCL采用扩散模型生成对比视图,在对比学习阶段有效减轻噪声的影响。此外,它通过稳定的ID嵌入对齐不同的视觉和文本语义信息,从而提高了跨模态的语义一致性。最后,引入物品-物品图增强了多模态特征表示,从而缓解了数据稀疏性对整体系统性能的不利影响。我们在三个公开数据集上进行了大量实验,结果表明DiffCL具有优越性和有效性。
英文摘要:
Multimodal recommendation systems integrate diverse multimodal information into the feature representations of both items and users, thereby enabling a more comprehensive modeling of user preferences. However, existing methods are hindered by data sparsity and the inherent noise within multimodal data, which impedes the accurate capture of users' interest preferences. Additionally, discrepancies in the semantic representations of items across different modalities can adversely impact the prediction accuracy of recommendation models. To address these challenges, we introduce a novel diffusion-based contrastive learning framework (DiffCL) for multimodal recommendation. DiffCL employs a diffusion model to generate contrastive views that effectively mitigate the impact of noise during the contrastive learning phase. Furthermore, it improves semantic consistency across modalities by aligning distinct visual and textual semantic information through stable ID embeddings. Finally, the introduction of the Item-Item Graph enhances multimodal feature representations, thereby alleviating the adverse effects of data sparsity on the overall system performance. We conduct extensive experiments on three public datasets, and the results demonstrate the superiority and effectiveness of the DiffCL.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。