arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.20723cs.AI
收藏

模态引导的图专家混合网络与熵触发路由用于多模态推荐

Modality-Guided Mixture of Structured Experts with Entropy-Triggered Routing for Multimodal Recommendation

Beijing University of Posts and Telecommunications(北京邮电大学);Tianjin University of Technology(天津理工大学)

Ji Dai, Quan Fang, DeSheng Cai

AI总结:

MAGNET通过模态引导的图专家混合网络与熵触发路由,提升多模态推荐中融合的可控性、稳定性和可解释性。

摘要:

多模态推荐通过整合用户-物品交互与物品内容来增强排序,特别是在稀疏反馈和长尾分布下效果尤为显著。然而,多模态信号本质上是异质的,并且在特定情境下可能会产生冲突,这使得有效的融合既重要又具有挑战性。现有方法往往依赖于共享的融合路径,导致纠缠的表示和模态不平衡。为了解决这些问题,我们提出了MAGNET,一种模态引导的自适应图专家混合网络,采用逐步熵触发路由用于多模态推荐,旨在增强多模态融合的可控性、稳定性和可解释性。MAGNET结合了交互条件的专家路由与结构感知的图增强,使得融合什么和如何融合都得到显式控制和可解释。在表示层面,一个双视图图学习模块通过内容诱导的边增强交互图,提高对稀疏和长尾物品的覆盖范围,同时通过并行编码和轻量级融合保持协作结构。在融合层面,MAGNET采用具有明确模态角色的结构化专家——主导、平衡和互补——以实现更可解释和适应性的行为、视觉和文本线索组合。为进一步稳定稀疏路由并防止专家崩溃,我们引入了两阶段熵加权机制,该机制监控路由熵。这种机制会自动将训练从早期的覆盖导向阶段过渡到后期的专业化导向阶段,逐步平衡专家使用和路由信心。在公开基准上的广泛实验表明,与强大的基线相比,有持续的改进。

英文摘要:

Multimodal recommenders combine collaborative behavior with visual and textual item evidence, whose usefulness varies across user-item interactions. Independently trained source-specific diagnostic probes partition held-out interactions into behavior-, appearance-, semantics-, and mixed-evidence regimes across five benchmarks, within which capacity-matched fixed fusion rules exhibit systematic regime-dependent performance crossovers. This diagnostic observation motivates MAGNET, a multimodal graph recommender with two core mechanisms. First, a calibrated expert bank organizes trainable experts by anchor source (behavior, appearance, or semantics) and fusion family (dominant, balanced, or complementary), while an interaction-conditioned router selects a sparse composition using all three evidence sources. Second, an entropy-triggered, coverage-aware progressive schedule decouples population-level routing-mass coverage from per-instance decisiveness, transitioning from broad routing exploration to confident specialization once sufficient coverage is sustained, while preserving coverage thereafter. MAGNET separately encodes the observed interaction graph and a filtered content-induced structural view, applying cross-view alignment after independent propagation. We evaluate MAGNET on four Amazon domains and the non-Amazon MicroLens-100K benchmark, including tail-item and low-history warm-start user evaluation alongside matched expert-design controls. Under the shared-feature, fixed-split protocol, MAGNET-DV exceeds the strongest protocol-compatible non-MAGNET baseline in every reported main-table cell, supported by seed-wise difference tests. Both the fixed and KL-anchored structured variants achieve higher five-seed mean NDCG@20 than matched homogeneous and free-mixture alternatives across all five datasets. MAGNET supports route-level diagnostics through explicit expert semantics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑