arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.22963cs.AI
收藏

FactGuard:通过强化学习进行代理视频虚假信息检测

FactGuard: Agentic Video Misinformation Detection via Reinforcement Learning

Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China(中国科学院计算技术研究所);University of Chinese Academy of Sciences, Beijing, China(中国科学院大学);University of Science and Technology Beijing(北京科技大学);The University of Queensland, Brisbane, Australia(昆士兰大学)

Zehao Li, Hongwei Yu, Hao Jiang, Qiang Sheng, Yilong Xu, Baolong Bi, Yang Li, Zhenlong Yuan, Yujun Cai, Zhaoqi Wang

AI总结:

FactGuard通过强化学习和代理框架,提升视频虚假信息检测的鲁棒性和泛化能力。

摘要:

多模态大语言模型(MLLMs)通过统一的多模态推理显著提升了视频虚假信息检测能力,但它们通常依赖固定深度的推理,并过度信任内部生成的假设,特别是在关键证据稀缺、碎片化或需要外部验证的情况下。为了解决这些限制,我们提出了FactGuard,一种用于视频虚假信息检测的代理框架,将验证建模为基于MLLMs的迭代推理过程。FactGuard明确评估任务模糊性,并选择性地调用外部工具获取关键证据,从而实现推理轨迹的逐步细化。为进一步加强这一能力,我们引入了两阶段训练策略,结合领域特定的代理监督微调与决策感知的强化学习,以优化工具使用并校准风险敏感的决策制定。在FakeSV、FakeTT和FakeVV上的广泛实验表明,FactGuard在状态-of-the-art性能上表现出色,并验证了其出色的鲁棒性和泛化能力。

英文摘要:

Multimodal large language models (MLLMs) have substantially advanced video misinformation detection through unified multimodal reasoning, but they often rely on fixed-depth inference and place excessive trust in internally generated assumptions, particularly in scenarios where critical evidence is sparse, fragmented, or requires external verification. To address these limitations, we propose FactGuard, an agentic framework for video misinformation detection that formulates verification as an iterative reasoning process built upon MLLMs. FactGuard explicitly assesses task ambiguity and selectively invokes external tools to acquire critical evidence, enabling progressive refinement of reasoning trajectories. To further strengthen this capability, we introduce a two-stage training strategy that combines domain-specific agentic supervised fine-tuning with decision-aware reinforcement learning to optimize tool usage and calibrate risk-sensitive decision making. Extensive experiments on FakeSV, FakeTT, and FakeVV demonstrate FactGuard's state-of-the-art performance and validate its excellent robustness and generalization capacity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑