arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.10079cs.CV
收藏

图像拼接和复制移动伪造能否由同一模型检测?Forensim:一种基于注意力的状态空间方法

Can Image Splicing and Copy-Move Forgery Be Detected by the Same Model? Forensim: An Attention-Based State-Space Approach

USC Information Sciences Institute(USC信息科学研究所);USC Thomas Lord Department of Computer Science(USC托马斯·劳德计算机科学系)

Soumyaroop Nandi, Prem Natarajan

AI总结:

Forensim通过基于注意力的状态空间方法,实现图像拼接和复制移动伪造的联合定位检测,并发布新数据集提升伪造检测性能。

摘要:

我们介绍了Forensim,一种基于注意力的状态空间框架,用于图像伪造检测,能够同时定位被篡改(目标)和源区域。与传统方法仅依赖于拼接或伪造区域的特征线索不同,Forensim旨在捕捉对上下文理解至关重要的复制模式。在如抗议影像等场景中,仅检测伪造区域,例如将暴力行为插入平静人群,可能会误导解释,凸显了联合源-目标定位的必要性。Forensim输出三种类别掩码(原始、源、目标),并在统一架构中支持检测拼接和复制移动伪造。我们提出了一种视觉状态空间模型,利用归一化注意力图来识别内部相似性,并配以基于区域的块注意力模块来区分篡改区域。这种设计使模型能够实现端到端训练和精确定位。Forensim在标准基准上实现了最先进的性能。我们还发布了CMFD-Anything,一个新数据集,旨在解决现有复制移动伪造数据集的局限性。

英文摘要:

We introduce Forensim, an attention-based state-space framework for image forgery detection that jointly localizes both manipulated (target) and source regions. Unlike traditional approaches that rely solely on artifact cues to detect spliced or forged areas, Forensim is designed to capture duplication patterns crucial for understanding context. In scenarios such as protest imagery, detecting only the forged region, for example a duplicated act of violence inserted into a peaceful crowd, can mislead interpretation, highlighting the need for joint source-target localization. Forensim outputs three-class masks (pristine, source, target) and supports detection of both splicing and copy-move forgeries within a unified architecture. We propose a visual state-space model that leverages normalized attention maps to identify internal similarities, paired with a region-based block attention module to distinguish manipulated regions. This design enables end-to-end training and precise localization. Forensim achieves state-of-the-art performance on standard benchmarks. We also release CMFD-Anything, a new dataset addressing limitations of existing copy-move forgery datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑