arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2507.04410cs.CVcs.AIcs.IR
收藏

通过多智能体深度研究多模态大型语言模型进行多媒体验证

Multimedia Verification Through Multi-Agent Deep Research Multimodal Large Language Models

University of New Brunswick(新 Brunswick大学);Institute for Clarity in Documentation(文档清晰研究所);Inria Paris-Rocquencourt(巴黎-罗克琴特研究所);Rajiv Gandhi University(拉贾·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒尔研究实验室)

Huy Hoan Le, Van Sy Thinh Nguyen, Thi Le Chi Dang, Vo Thanh Khang Nguyen, Truong Thanh Hung Nguyen, Hung Cao

AI总结:

针对ACMMM25多媒体验证挑战赛,提出结合多模态大型语言模型与专业工具的多智能体验证系统,经六阶段运行及核心智能体的四种工具应用,在复杂数据集上成功验证内容真实性并追踪来源,有效应对现实场景。

摘要:

本文介绍了我们提交给ACMMM25多媒体验证挑战赛的成果。我们开发了一个多智能体验证系统,将多模态大型语言模型(MLLMs)与专业验证工具相结合,以检测多媒体错误信息。该系统通过六个阶段运行:原始数据处理、规划、信息提取、深度研究、证据收集和报告生成。核心深度研究员智能体使用四种工具:反向图像搜索、元数据分析、事实核查数据库,以及提取空间、时间、归因和动机背景的已验证新闻处理工具。我们在包含复杂多媒体内容的挑战赛数据集样本上展示了该方法,系统成功验证了内容真实性,提取了精确的地理位置和时间信息,并跨多个平台追踪了来源归因,有效应对了现实世界的多媒体验证场景。

英文摘要:

This paper presents our submission to the ACMMM25 - Grand Challenge on Multimedia Verification. We developed a multi-agent verification system that combines Multimodal Large Language Models (MLLMs) with specialized verification tools to detect multimedia misinformation. Our system operates through six stages: raw data processing, planning, information extraction, deep research, evidence collection, and report generation. The core Deep Researcher Agent employs four tools: reverse image search, metadata analysis, fact-checking databases, and verified news processing that extracts spatial, temporal, attribution, and motivational context. We demonstrate our approach on a challenge dataset sample involving complex multimedia content. Our system successfully verified content authenticity, extracted precise geolocation and timing information, and traced source attribution across multiple platforms, effectively addressing real-world multimedia verification scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑