arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2502.01699cs.LGcs.CLcs.CVcs.IRcs.MM
收藏

用于假新闻检测的具有内在判别特征利用的多模态逆向注意力网络

Multimodal Inverse Attention Network with Intrinsic Discriminant Feature Exploitation for Fake News Detection

School of Information Science and Engineering, Shandong Normal University(山东师范大学信息科学与工程学院);Faculty of Engineering & Information Technology, University of Technology Sydney(悉尼科技大学工程与信息技术学院)

Tianlin Zhang, En Yu, Yi Shao, Jiande Sun

AI总结:

针对多模态假新闻检测中未能充分利用模态特定表示和显式差异特征的问题,提出多模态逆向注意力网络(MIAN),通过分层学习、跨模态交互和逆向注意力机制提取内在判别与不一致特征,显著优于现有方法。

摘要:

多模态假新闻检测因其对社会安全的深远影响而备受关注。尽管现有方法有助于理解跨模态一致性,但它们往往未能利用模态特定表示和显式差异特征。为了解决这些局限性,我们提出了一种多模态逆向注意力网络(MIAN),这是一种基于新闻内容探索内在判别特征以推进假新闻检测的新颖框架。具体而言,MIAN引入了一个分层学习模块,通过局部到全局和局部到局部的交互来捕获多样的模态内关系,从而生成增强的单模态表示,以改善模态内层面的假新闻识别。此外,跨模态交互模块采用协同注意力机制来建立和建模精炼单模态表示之间的依赖关系,促进跨模态的无缝语义整合。为了显式提取不一致性特征,我们提出了一种逆向注意力机制,有效突出了假新闻在模态内和模态间引入的冲突模式和语义偏差。在基准数据集上的大量实验表明,MIAN显著优于最先进的方法,突显了其通过增强多模态假新闻检测来推进社会安全的关键贡献。

英文摘要:

Multimodal fake news detection has garnered significant attention due to its profound implications for social security. While existing approaches have contributed to understanding cross-modal consistency, they often fail to leverage modal-specific representations and explicit discrepant features. To address these limitations, we propose a Multimodal Inverse Attention Network (MIAN), a novel framework that explores intrinsic discriminative features based on news content to advance fake news detection. Specifically, MIAN introduces a hierarchical learning module that captures diverse intra-modal relationships through local-to-global and local-to-local interactions, thereby generating enhanced unimodal representations to improve the identification of fake news at the intra-modal level. Additionally, a cross-modal interaction module employs a co-attention mechanism to establish and model dependencies between the refined unimodal representations, facilitating seamless semantic integration across modalities. To explicitly extract inconsistency features, we propose an inverse attention mechanism that effectively highlights the conflicting patterns and semantic deviations introduced by fake news in both intra- and inter-modality. Extensive experiments on benchmark datasets demonstrate that MIAN significantly outperforms state-of-the-art methods, underscoring its pivotal contribution to advancing social security through enhanced multimodal fake news detection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑