Misinformation has become a major challenge in the era of increasing digital information, requiring the development of effective detection methods. We have investigated a novel approach to Out-Of-Context detection (OOCD) that uses synthetic data generation. We created a dataset specifically designed for OOCD and developed an efficient detector for accurate classification. Our experimental findings validate the use of synthetic data generation and demonstrate its efficacy in addressing the data limitations associated with OOCD. The dataset and detector should serve as valuable resources for future research and the development of robust misinformation detection systems.
Insight-A: Attribution-aware for Multimodal Misinformation Detection
School of Computer Science and Technology, Soochow University(苏州大学计算机科学与技术学院);Institute of Artificial Intelligence, Soochow University(苏州大学人工智能研究院);School of Computer Science and Technology, Harbin Institute of Technology(哈尔滨工业大学计算机科学与技术学院)
MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMs
Beijing University of Posts and Telecommunications(北京邮电大学);University of California, Santa Barbara(加州大学圣巴巴拉分校);Center for Research on Intelligent Perception and Computing, NLPR, CASIA(中国科学院自动化研究所模式识别国家重点实验室智能感知与计算研究中心)
Multimodal Misinformation Detection by Learning from Synthetic Data with Multimodal LLMs
School of Computing and Information Systems, Singapore Management University(新加坡管理大学计算与信息系统学院);Institute of Operations Research and Analytics, National University of Singapore(新加坡国立大学运筹学与分析研究所)
A New Dataset and Benchmark for Grounding Multimodal Misinformation
National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University(多媒体软件国家工程研究中心,计算机科学学院,武汉大学);School of Computing, National University of Singapore(计算学院,新加坡国立大学);School of Computer Science, Peking University(计算机科学学院,北京大学);State Key Laboratory for Multimedia Information Processing, Peking University(多媒体信息处理国家重点实验室,北京大学)
Harmfully Manipulated Images Matter in Multimodal Misinformation Detection
Key Laboratory of Symbolic Computation and Knowledge Engineering of the Ministry of Education, Jilin University(吉林大学 教育部符号计算与知识工程重点实验室);College of Computer Science and Technology, Jilin University(吉林大学 计算机科学与技术学院)
Towards Explainable Bilingual Multimodal Misinformation Detection and Localization
University of Liverpool, United Kingdom(利物浦大学);National University of Singapore, Singapore(新加坡国立大学);The Chinese University of Hong Kong, Shenzhen, China(香港中文大学(深圳))
MM-VeriAgent: Learning to Use Extensive Tools to Verify Multimodal Misinformation with Reinforcement Learning
Beijing University of Posts and Telecommunications(北京邮电大学);Minzu University of China(中央民族大学);NLPR, Institute of automation, Chinese academy of science, Chinese Academy of Sciences(中国科学院自动化研究所模式识别国家重点实验室)
Latent Reconstruction from Generated Data for Multimodal Misinformation Detection
Information Technology Institute, Centre for Research & Technology, Hellas(信息科技研究所,研究中心,希腊);Department of Electrical & Computer Engineering, Aristotle University of Thessaloniki(电气与计算机工程系,亚里士多德大学)
SpMis: An Investigation of Synthetic Spoken Misinformation Detection
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Northeastern University(东北大学);Beijing Institute of Technology(北京理工大学);Huawei International Pte Ltd(华为国际私人有限公司);Huawei Technologies Co., Ltd(华为技术有限公司)
College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);College of Software, Jilin University(吉林大学软件学院);School of Computer and Artificial Intelligence, Liaoning Normal University(辽宁师范大学计算机与人工智能学院);School of Computer Science and Technology, Soochow University(苏州大学计算机科学与技术学院);Department of Computer Science, Swansea University(斯旺西大学计算机科学系)
Unveiling Modality Bias: Automated Sample-Specific Analysis for Multimodal Misinformation Benchmarks
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));City University of Hong Kong(香港城市大学);Sun Yat-sen University(中山大学);Harbin Institute of Technology(哈尔滨工业大学);Nanyang Technological University(新加坡国立大学)
Similarity over Factuality: Are we making progress on multimodal out-of-context misinformation detection?
Information Technology Institute, Centre for Research & Technology, Hellas(希腊研究与技术中心信息技术研究所);Department of Electrical & Computer Engineering, Aristotle University of Thessaloniki(亚里士多德大学电气与计算机工程系)
Echoes of Unrest: A Multimodal NLP Framework for Early Warning of Fake News and Violence-Driven Mob Activity
Department of Computer Science and Engineering, Dhaka International University(达卡国际大学计算机科学与工程系);Department of Computer Science and Engineering, Bangladesh University of Engineering and Technology(孟加拉国工程技术大学计算机科学与工程系)
HiEAG: Evidence-Augmented Generation for Out-of-Context Misinformation Detection
School of Computer Science and Technology, Soochow University(苏州大学计算机科学与技术学院);Institute of Artificial Intelligence, Soochow University(苏州大学人工智能研究院);School of Computer Science and Technology, Harbin Institute of Technology(哈尔滨工业大学计算机科学与技术学院)
Edited Media Understanding Frames: Reasoning About the Intent and Implications of Visual Misinformation
Allen Institute for Artificial Intelligence(艾伦人工智能研究所);University of Michigan(密歇根大学);Paul G. Allen School of Computer Science & Engineering, University of Washington(华盛顿大学保罗·G·艾伦计算机科学与工程学院);Stanford University(斯坦福大学)
MM-Claims: A Dataset for Multimodal Claim Detection in Social Media
TIB – Leibniz Information Centre for Science and Technology(莱布尼茨科技信息中心(TIB));L3S Research Center, Leibniz University Hannover(汉诺威莱布尼茨大学L3S研究中心);Jozef Stefan Institute(约瑟夫·斯特凡研究所)
E-CaTCH: Event-Centric Cross-Modal Attention with Temporal Consistency and Class-Imbalance Handling for Misinformation Detection
Department of Mathematics and Statistics, American University, Washington, DC, USA(数学与统计学系,美国大学,华盛顿特区,美国);Department of Computer Science and Mathematics, Pennsylvania State University, Harrisburg, PA, USA(计算机科学与数学系,宾夕法尼亚州立大学,哈里斯堡,宾夕法尼亚州,美国);Department of Computer Science, American University, Washington, DC, USA(计算机科学系,美国大学,华盛顿特区,美国)