arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2601.15316cs.AIcs.CV

范式转变:大型视觉语言模型在多模态虚假新闻检测中的全面调查

The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detection

College of Computer and Mathematics, Central South University of Forestry and Technology(计算机与数学学院,中央南大学林业科技学院);College of Computer Science and Electronic Engineering, Hunan University(计算机科学与电子工程学院,湖南大学);College of Economics and Management, Central South University of Forestry and Technology(经济管理学院,中央南大学林业科技学院);Department of Computer Science, State University of New York(计算机科学系,纽约州立大学)

Wei Ai, Yilong Tan, Yuntao Shou, Tao Meng, Haowen Chen, Zhixiong He, Keqin Li

AI总结:

本文通过大型视觉语言模型全面调查多模态虚假新闻检测,分析其发展历程、技术挑战及未来方向。

摘要:

近年来,大型视觉语言模型(LVLMs)的快速演变推动了多模态虚假新闻检测(MFND)的范式转变,使其从传统的特征工程方法转变为统一的端到端多模态推理框架。早期方法主要依赖于浅层融合技术来捕捉文本和图像之间的相关性,但它们在高层语义理解和复杂跨模态交互方面存在困难。LVLMs的出现从根本上改变了这一局面,通过强大的表示学习实现了视觉和语言的联合建模,从而增强了检测利用文本叙述和视觉内容的虚假信息的能力。尽管取得了这些进展,该领域仍然缺乏一个系统性的调查来追踪这一转变并汇总最近的发展。为了解决这一缺口,本文通过LVLMs的视角对MFND进行了全面的回顾。我们首先提供了一种历史视角,将演变从传统的多模态检测流程映射到基础模型驱动的范式。接下来,我们建立了涵盖模型架构、数据集和性能基准的结构化分类法。此外,我们分析了剩余的技术挑战,包括可解释性、时间推理和领域泛化。最后,我们概述了未来的研究方向,以指导这一范式转变的下一阶段。据我们所知,这是第一个系统性地记录和分析LVLMs在对抗多模态虚假新闻中的变革作用的全面调查。现有方法的总结在我们的GitHub上:https://github.com/Tan-YiLong/Overview-of-Fake-News-Detection

英文摘要:

In recent years, the rapid evolution of large vision-language models (LVLMs) has driven a paradigm shift in multimodal fake news detection (MFND), transforming it from traditional feature-engineering approaches to unified, end-to-end multimodal reasoning frameworks. Early methods primarily relied on shallow fusion techniques to capture correlations between text and images, but they struggled with high-level semantic understanding and complex cross-modal interactions. The emergence of LVLMs has fundamentally changed this landscape by enabling joint modeling of vision and language with powerful representation learning, thereby enhancing the ability to detect misinformation that leverages both textual narratives and visual content. Despite these advances, the field lacks a systematic survey that traces this transition and consolidates recent developments. To address this gap, this paper provides a comprehensive review of MFND through the lens of LVLMs. We first present a historical perspective, mapping the evolution from conventional multimodal detection pipelines to foundation model-driven paradigms. Next, we establish a structured taxonomy covering model architectures, datasets, and performance benchmarks. Furthermore, we analyze the remaining technical challenges, including interpretability, temporal reasoning, and domain generalization. Finally, we outline future research directions to guide the next stage of this paradigm shift. To the best of our knowledge, this is the first comprehensive survey to systematically document and analyze the transformative role of LVLMs in combating multimodal fake news. The summary of existing methods mentioned is in our Github: \href{https://github.com/Tan-YiLong/Overview-of-Fake-News-Detection}{https://github.com/Tan-YiLong/Overview-of-Fake-News-Detection}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑