arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.03014cs.IRcs.AI
收藏

面向用户的条件生成总相关性学习多模态推荐

User-Aware Conditional Generative Total Correlation Learning for Multi-Modal Recommendation

The University of New South Wales(新南威尔士大学);University of Melbourne(墨尔本大学);New York University Abu Dhabi(纽约大学阿布扎比分校)

Jing Du, Zesheng Ye, Congbo Ma, Feng Liu, Flora. D. Salim

AI总结:

本文提出GTC框架,通过用户感知的内容特征过滤和总相关性优化,提升多模态推荐的性能,实验表明在NDCG@5上提升达28.30%。

摘要:

多模态推荐(MMR)通过引入物品内容(如视觉和文本描述)来丰富物品表示,以改进仅基于交互的推荐器。MMR的成功依赖于将这些内容模态与从交互数据中推导出的用户偏好对齐,但基于解耦模态不变偏好驱动信号与模态特定偏好无关噪音的主流方法存在缺陷。首先,它们假设物品内容对所有用户都有相同的相关性,这与用户条件的偏好事实相矛盾。其次,它们分别优化成对对比损失以实现跨模态对齐,系统性地忽略了当多个内容模态共同影响用户选择时固有的更高阶依赖关系。在本文中,我们引入GTC,一种条件生成总相关性学习框架。我们采用交互引导的扩散模型进行用户感知的内容特征过滤,仅保留与每位用户相关的个性化特征。此外,为了捕捉完整的跨模态依赖关系,我们优化了所有模态下物品表示总相关性的可 tractable 下界。在标准MMR基准测试中,GTC在NDCG@5上一致优于最先进的方法,提升达28.30%。消融研究验证了两者条件偏好驱动的特征过滤和总相关性优化,确认了GTC在MMR任务中建模用户条件关系的能力。代码可在:https://github.com/jingdu-cs/GTC。

英文摘要:

Multi-modal recommendation (MMR) enriches item representations by introducing item content, e.g., visual and textual descriptions, to improve upon interaction-only recommenders. The success of MMR hinges on aligning these content modalities with user preferences derived from interaction data, yet dominant practices based on disentangling modality-invariant preference-driving signals from modality-specific preference-irrelevant noises are flawed. First, they assume a one-size-fits-all relevance of item content to user preferences for all users, which contradicts the user-conditional fact of preferences. Second, they optimize pairwise contrastive losses separately toward cross-modal alignment, systematically ignoring higher-order dependencies inherent when multiple content modalities jointly influence user choices. In this paper, we introduce GTC, a conditional Generative Total Correlation learning framework. We employ an interaction-guided diffusion model to perform user-aware content feature filtering, preserving only personalized features relevant to each individual user. Furthermore, to capture complete cross-modal dependencies, we optimize a tractable lower bound of the total correlation of item representations across all modalities. Experiments on standard MMR benchmarks show GTC consistently outperforms state-of-the-art, with gains of up to 28.30% in NDCG@5. Ablation studies validate both conditional preference-driven feature filtering and total correlation optimization, confirming the ability of GTC to model user-conditional relationships in MMR tasks. The code is available at: https://github.com/jingdu-cs/GTC.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑