Multimedia Verification Through Multi-Agent Deep Research Multimodal Large Language Models
University of New Brunswick(新 Brunswick大学);Institute for Clarity in Documentation(文档清晰研究所);Inria Paris-Rocquencourt(巴黎-罗克琴特研究所);Rajiv Gandhi University(拉贾·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒尔研究实验室)
Huy Hoan Le, Van Sy Thinh Nguyen, Thi Le Chi Dang, Vo Thanh Khang Nguyen, Truong Thanh Hung Nguyen, Hung Cao
This paper presents our submission to the ACMMM25 - Grand Challenge on Multimedia Verification. We developed a multi-agent verification system that combines Multimodal Large Language Models (MLLMs) with specialized verification tools to detect multimedia misinformation. Our system operates through six stages: raw data processing, planning, information extraction, deep research, evidence collection, and report generation. The core Deep Researcher Agent employs four tools: reverse image search, metadata analysis, fact-checking databases, and verified news processing that extracts spatial, temporal, attribution, and motivational context. We demonstrate our approach on a challenge dataset sample involving complex multimedia content. Our system successfully verified content authenticity, extracted precise geolocation and timing information, and traced source attribution across multiple platforms, effectively addressing real-world multimedia verification scenarios.
MERLIN: Multimodal Embedding Refinement via LLM-based Iterative Navigation for Text-Video Retrieval-Rerank Pipeline
Buzzni AI Lab(Buzzni人工智能实验室);KAIST(韩国科学技术院);Mathpresso Inc.(Mathpresso公司);UC Berkeley(加州大学伯克利分校);Fainders AI(Fainders人工智能公司);Seoul National University(首尔大学)
Instruction-Guided Editing Controls for Images and Multimedia: A Survey in LLM era
Griffith University(格里菲斯大学);University of Bremen(不来梅大学);Ho Chi Minh City University of Technology(胡志明市技术大学);École Polytechnique Fédérale de Lausanne(洛桑联邦理工学院);Hanoi University of Science and Technology(河内科技大学);The University of Queensland(昆士兰大学)
Reflect to Inform: Boosting Multimodal Reasoning via Information-Gain-Driven Verification
University of Science and Technology of China(中国科学技术大学);Huawei Foundation Model Department(华为基础模型部);The Chinese University of Hong Kong(香港中文大学);Hong Kong University of Science and Technology(香港科技大学)
SVSR: A Self-Verification and Self-Rectification Paradigm for Multimodal Reasoning
South China Agricultural University(华南农业大学);University of Glasgow(格拉斯哥大学);University of Electronic Science and Technology of China(电子科技大学);Monash University(莫纳什大学);University of Science and Technology of China(中国科学技术大学);National University of Defense Technology(国防科技大学);Renmin University of China(中国人民大学);South China Normal University(华南师范大学)
Detecting Multimedia Generated by Large AI Models: A Survey
Department of Computer and Information Technology, Purdue University(普渡大学计算机与信息科技系);School of Software, Nanchang University(南昌大学软件学院);Amazon Prime Video(亚马逊Prime视频);Department of Epidemiology and Biostatistics, School of Public Health(公共卫生学院流行病学与生物统计学系);Department of Computer Science, College of Nanotechnology, Science, and Engineering(纳米技术、科学与工程学院计算机科学系);University at Albany, SUNY(阿尔巴尼大学)
When to Rethink: Learning Multi-Perspective Self-Verification for Vision-Language Models
University of Leicester(莱斯特大学);Nanjing University of Posts and Telecommunications(南京邮电大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Amazon(亚马逊);University of Exeter(埃克塞特大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Meta AI;Eindhoven University of Technology(埃因霍温理工大学)
Modality-Balanced Learning for Multimedia Recommendation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
A Multimodal Approach to Predict Social Media Popularity
Nirma Institute of Technology(尼玛理工学院);Delhi Technological University(德里理工大学);UALR(阿肯色大学小石城分校);National University of Singapore(新加坡国立大学);IIIT-Delhi(德里英迪拉·甘地信息技术学院)
多个模态表示数据源传递信息的不同方面。现代社交媒体平台是多模态数据的主要来源之一,其中用户通过发布文本以及多媒体内容(例如图像和视频)来使用不同的表达模式以共享信息。这些帖子中包含的多模式信息可能有助于预测其受欢迎程度。据我们所知,不存在这样的多模态数据集来预测社交媒体照片。在这项工作中,我们提出了一个多模态数据集consistiting的内容,上下文和社会信息的流行预测。具体来说,我们在ACM Multimedia Grand Challenge 2017中使用图像内容,标题,描述和标签来增强SMPT 1数据集的社交媒体预测。接下来,在本文中,我们提出了一种利用视觉特征(即,内容信息),文本特征(即,上下文信息),以及社交特征(例如,平均视图和组计数)来预测社交媒体照片在视图计数方面的流行度。实验结果证实,尽管我们的多模态方法使用了来自SMP-T1的训练数据集的一半,但它实现了与最先进的方法相当的性能。
Bridging Pixels and Words: Mask-Aware Local Semantic Fusion for Multimodal Media Verification
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人工智能与机器人研究所人机混合增强智能全国重点实验室)
Swarm Robotics Lab NCRA(国家机器人与自动化中心群体机器人实验室);Deutsches Elektronen-Synchrotron DESY(德国电子同步加速器研究所);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Engineering and Technology Taxila(塔克西拉工程技术大学);Information Technology University(信息技术大学)
Semantic-Spatial Agreement Verification for Mitigating Object Hallucination in Multimodal Large Language Models
Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东省科学院));Shandong Computer Science Center (National Supercomputer Center in Jinan)(山东省计算中心(国家超级计算济南中心));China Telecom Digital Intelligence Technology Co., Ltd.(中国电信数字智能科技有限公司);Shenyang Aerospace University(沈阳航空航天大学)