arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.08211cs.CV
收藏

SciFigDetect:一种用于AI生成科学图表检测的基准测试

SciFigDetect: A Benchmark for AI-Generated Scientific Figure Detection

Zhejiang University(浙江大学);Independent Researcher(独立研究员);University of Oulu(奥卢大学)

You Hu, Chenzhuo Zhao, Changfa Mo, Haotian Liu, Xiaobai Li

AI总结:

本文提出首个AI生成科学图表检测基准,通过多模态数据管道构建,涵盖多种图表类别和生成源,揭示现有方法在零样本迁移和对抗性攻击下的不足。

摘要:

现代多模态生成器能够以接近可发表的质量生成科学图表,给视觉取证和科研诚信带来新挑战。与传统AI生成自然图像不同,科学图表结构化、文本密集且紧密关联学术语义,使其成为独特的检测目标。然而,现有AI生成图像检测基准和方法几乎全部针对开放领域图像,未探索此场景。本文提出首个AI生成科学图表检测基准,通过开发基于代理的数据管道,检索授权源论文,进行论文文本和图表的多模态理解,构建结构化提示,合成候选图表,并通过审查驱动的精炼循环过滤。所得基准涵盖多种图表类别、多种生成源及对齐的真实-合成配对。在零样本、跨生成器和退化图像设置下,对代表性检测器进行评估。结果显示,现有方法在零样本迁移中表现差,存在强生成器特异性过拟合,且在常见后处理篡改下脆弱。这些发现揭示了现有AIGI检测能力与高质量科学图表新兴分布之间的显著差距。本文希望该基准能为未来研究鲁棒且通用的科学图表取证提供基础。数据集可在https://github.com/Joyce-yoyo/SciFigDetect获取。

英文摘要:

Modern multimodal generators can now produce scientific figures at near-publishable quality, creating a new challenge for visual forensics and research integrity. Unlike conventional AI-generated natural images, scientific figures are structured, text-dense, and tightly aligned with scholarly semantics, making them a distinct and difficult detection target. However, existing AI-generated image detection benchmarks and methods are almost entirely developed for open-domain imagery, leaving this setting largely unexplored. We present the first benchmark for AI-generated scientific figure detection. To construct it, we develop an agent-based data pipeline that retrieves licensed source papers, performs multimodal understanding of paper text and figures, builds structured prompts, synthesizes candidate figures, and filters them through a review-driven refinement loop. The resulting benchmark covers multiple figure categories, multiple generation sources and aligned real--synthetic pairs. We benchmark representative detectors under zero-shot, cross-generator, and degraded-image settings. Results show that current methods fail dramatically in zero-shot transfer, exhibit strong generator-specific overfitting, and remain fragile under common post-processing corruptions. These findings reveal a substantial gap between existing AIGI detection capabilities and the emerging distribution of high-quality scientific figures. We hope this benchmark can serve as a foundation for future research on robust and generalizable scientific-figure forensics. The dataset is available at https://github.com/Joyce-yoyo/SciFigDetect.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑