The proliferation of inflammatory or misleading "fake" news content has become increasingly common in recent years. Simultaneously, it has become easier than ever to use AI tools to generate photorealistic images depicting any scene imaginable. Combining these two -- AI-generated fake news content -- is particularly potent and dangerous. To combat the spread of AI-generated fake news, we propose the MiRAGeNews Dataset, a dataset of 12,500 high-quality real and AI-generated image-caption pairs from state-of-the-art generators. We find that our dataset poses a significant challenge to humans (60% F-1) and state-of-the-art multi-modal LLMs (< 24% F-1). Using our dataset we train a multi-modal detector (MiRAGe) that improves by +5.1% F-1 over state-of-the-art baselines on image-caption pairs from out-of-domain image generators and news publishers. We release our code and data to aid future work on detecting AI-generated content.
School of Computer Science and Technology, Dalian University of Technology（大连理工大学计算机科学与技术学院）；School of Computer Science, Fudan University（复旦大学计算机学院）；School of Software, Dalian University of Technology（大连理工大学软件学院）
Factify 2: A Multimodal Fake News and Satire News Dataset
IIIT Sri City（斯里城印度信息技术学院）；UCLA（加利福尼亚大学洛杉矶分校）；University of South Carolina（南卡罗来纳大学）；Carnegie Mellon University（卡内基梅隆大学）；Stanford（斯坦福大学）；Amazon AI（亚马逊人工智能）；Microsoft（微软公司）；IIT Patna（巴特那印度理工学院）；Georgia Tech（佐治亚理工学院）
Findings of Factify 2: Multimodal Fake News Detection
IIIT Sri City（印度信息技术学院斯里城校区）；University of South Carolina（南卡罗来纳大学）；University of California Los Angeles（加利福尼亚大学洛杉矶分校）；Stanford（斯坦福大学）；Amazon AI（亚马逊人工智能）；Carnegie Mellon University（卡内基梅隆大学）；Microsoft（微软公司）；IIT Patna（巴特那印度理工学院）；Georgia Tech（佐治亚理工学院）
Multimodal Fake News Detection: MFND Dataset and Shallow-Deep Multitask Learning
School of Artificial Intelligence, Hebei University of Technology（河北工业大学人工智能学院）；School of Computing and Information Technology, Great Bay University（大湾大学计算与信息学院）；Guangdong Provincial Key Laboratory of Intelligent Information Processing & Shenzhen Key Laboratory of Media Security, Shenzhen University（广东省智能信息处理重点实验室 & 深圳市媒体安全重点实验室）；Dongguan Key Laboratory for Intelligence and Information Technology（东莞智能信息科技重点实验室）
XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tags
Ahsanullah University of Science & Technology（阿萨努拉科技大学）；University of Alberta（阿尔伯塔大学）；Université de Sherbrooke（谢布鲁克大学）；Salesforce Research（Salesforce研究院）；Nanyang Technological University（南洋理工大学）
MM-Claims: A Dataset for Multimodal Claim Detection in Social Media
TIB – Leibniz Information Centre for Science and Technology（莱布尼茨科技信息中心（TIB））；L3S Research Center, Leibniz University Hannover（汉诺威莱布尼茨大学L3S研究中心）；Jozef Stefan Institute（约瑟夫·斯特凡研究所）
American Stories: A Large-Scale Structured Text Dataset of Historical U.S. Newspapers
Harvard University（哈佛大学）；Massachusetts Institute of Technology（麻省理工学院）；Princeton University（普林斯顿大学）；National Bureau of Economic Research（美国国家经济研究局）；New York University（纽约大学）；Northwestern University（西北大学）
NewsRECON: News Article Retrieval for Image Contextualization
Ubiquitous Knowledge Processing Lab (UKP Lab), Department of Computer Science, TU Darmstadt and National Research Center for Applied Cybersecurity ATHENE（通用知识处理实验室（UKP实验室）、计算机科学系、图恩大学（TU Darmstadt）和应用网络安全国家研究中心ATHENE）；Department of Electrical Engineering, KU Leuven（电气工程系、鲁汶大学）；Department of Computer Science, KU Leuven（计算机科学系、鲁汶大学）
EAMA : Entity-Aware Multimodal Alignment Based Approach for News Image Captioning
Wangxuan Institute of Computer Technology, Peking University（北京大学王选计算机研究所）；School of Electronics Engineering and Computer Science, Peking University（北京大学电子工程与计算机科学学院）
Towards Explainable Bilingual Multimodal Misinformation Detection and Localization
University of Liverpool, United Kingdom（利物浦大学）；National University of Singapore, Singapore（新加坡国立大学）；The Chinese University of Hong Kong, Shenzhen, China（香港中文大学（深圳））
How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models
Seoul National University（首尔大学）；Samaya AI；Allen Institute for AI（艾伦人工智能研究所）；Yonsei University（延世大学）；Carnegie Mellon University（卡内基梅隆大学）；University of Washington（华盛顿大学）；University of California, Los Angeles（加利福尼亚大学洛杉矶分校）；New York University（纽约大学）
Similarity over Factuality: Are we making progress on multimodal out-of-context misinformation detection?
Information Technology Institute, Centre for Research & Technology, Hellas（希腊研究与技术中心信息技术研究所）；Department of Electrical & Computer Engineering, Aristotle University of Thessaloniki（亚里士多德大学电气与计算机工程系）
Multimodal Inverse Attention Network with Intrinsic Discriminant Feature Exploitation for Fake News Detection
School of Information Science and Engineering, Shandong Normal University（山东师范大学信息科学与工程学院）；Faculty of Engineering & Information Technology, University of Technology Sydney（悉尼科技大学工程与信息技术学院）
Detecting and Explaining Fake News Short Videos with Multimodal Content and Real-World Evidence
AI and Social Good Lab, AI Media Centre（AI媒体中心人工智能与社会公益实验室）；Southern University of Science and Technology（南方科技大学）；Beijing Normal University（北京师范大学）；Hong Kong Baptist University（香港浸会大学）
Decoupling and Regulating Modality Heads for Fake News Detection under Missing Modality
Soochow University（苏州大学）；Hong Kong University of Science and Technology（香港科技大学）；Computer Science and Engineering, The Chinese University of Hong Kong（香港中文大学计算机科学与工程系）；The Hong Kong University of Science and Technology（香港科技大学）；FiT, Tencent（腾讯FiT）；Alibaba Group（阿里巴巴集团）；School of Computer Science and Engineering, Southeast University（东南大学计算机科学与工程学院）；School of Education, Zhejiang Normal University（浙江师范大学教育学院）
The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detection
College of Computer and Mathematics, Central South University of Forestry and Technology（计算机与数学学院，中央南大学林业科技学院）；College of Computer Science and Electronic Engineering, Hunan University（计算机科学与电子工程学院，湖南大学）；College of Economics and Management, Central South University of Forestry and Technology（经济管理学院，中央南大学林业科技学院）；Department of Computer Science, State University of New York（计算机科学系，纽约州立大学）
Perception, Understanding and Reasoning, A Multimodal Benchmark for Video Fake News Detection
The Hong Kong University of Science and Technology（香港科学与技术大学）；National University of Singapore（新加坡国立大学）；The Hong Kong Polytechnic University（香港理工大学）；Beijing University of Posts and Telecommunications（北京邮电大学）；Peking University（北京大学）
VMID: A Multimodal Fusion LLM Framework for Detecting and Identifying Misinformation of Short Videos
School of Information Science, Guangdong University of Finance and Economics（广东财经大学信息学院）；Guangdong Intelligent Business Engineering Technology Center（广东省智能商务工程技术中心）；Key Laboratory of Collaborative Innovation in Digital Economy（数字经济协同创新重点实验室）；School of Computer Science, Shandong University（山东大学计算机学院）
What's Left Unsaid? Detecting and Correcting Misleading Omissions in Multimodal News Previews
School of Information Science and Engineering, Yunnan University（云南大学信息科学与工程学院）；National University of Singapore（新加坡国立大学）；Xi’an Jiaotong University（西安交通大学）；School of Engineering, Yunnan University（云南大学工程学院）
RASR: Retrieval-Augmented Semantic Reasoning for Fake News Video Detection
School of Informatics, Xiamen University（厦门大学信息学院）；School of Computer Science and Information Security, Guilin University of Electronic Technology（桂林电子科技大学计算机科学与信息安全学院）；School of Computer and Big Data, Minjiang University（闽江学院计算机与大数据学院）；Xiamen University（厦门大学）；Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）
