arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.00730cs.IR
收藏

迈向可信的多模态推荐

Towards Trustworthy Multimodal Recommendation

Renmin University of China(中国人民大学)

Zixuan Li

AI总结:

本文提出了一种多模态推荐系统中的可信度校正方法,通过学习模态特征的软对应关系以提升鲁棒性,并验证了交互级可信度的两个关键观察。

摘要:

近期多模态推荐系统的研究表明,将视觉和文本内容整合到协同过滤中可以提高效果。然而,现实中的部署却提出了一个日益重要但尚未深入探讨的问题:可信度。在现代电子商务平台上,多模态内容可能具有误导性或不可靠(例如视觉不一致的产品图片或标题党),这些不可信的信号会注入到多模态表示中,使现有的推荐器在模态损坏下变得脆弱。在本工作中,我们从方法和分析的角度出发,迈出了可信多模态推荐的第一步。首先,我们提出了一种即插即用的模态级校正组件,通过学习项目与多模态特征之间的软对应关系,减轻不可信的模态特征。利用轻量级投影和基于Sinkhorn的软匹配,校正可以抑制不匹配的模态信号,同时保持语义一致性,并且可以不进行架构修改地集成到现有的多模态推荐系统中。其次,我们提出了两个关于在噪声协同信号下的交互级可信度的实用见解:(i)训练集伪交互在噪声下可能对性能有帮助或有害,这取决于先前信号的对齐;(ii)传播图伪边也可以帮助或损害鲁棒性,因为消息传递可能会放大不一致。在多个数据集和不同损坏水平下的大量实验验证了模态校正的鲁棒性提升,并验证了上述交互级观察。

英文摘要:

Recent advances in multimodal recommendation have demonstrated the effectiveness of incorporating visual and textual content into collaborative filtering. However, real-world deployments raise an increasingly important yet underexplored issue: trustworthiness. On modern e-commerce platforms, multimodal content can be misleading or unreliable (e.g., visually inconsistent product images or click-bait titles), injecting untrustworthy signals into multimodal representations and making existing recommenders brittle under modality corruption. In this work, we take a step towards trustworthy multimodal recommendation from both a method and an analysis perspective. First, we propose a plug-and-play modality-level rectification component that mitigates untrustworthy modality features by learning soft correspondences between items and multimodal features. Using lightweight projections and Sinkhorn-based soft matching, the rectification suppresses mismatched modality signals while preserving semantic consistency, and can be integrated into existing multimodal recommenders without architectural modifications. Second, we present two practical insights on interaction-level trustworthiness under noisy collaborative signals: (i) training-set pseudo interactions can help or hurt performance under noise depending on prior-signal alignment; and (ii) propagation-graph pseudo edges can also help or hurt robustness, as message passing may amplify misalignment. Extensive experiments on multiple datasets and backbones under varying corruption levels demonstrate improved robustness from modality rectification and validate the above interaction-level observations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑