arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.06998cs.CV
收藏

迈向有效图像取证:一种新型计算高效框架与一个新的图像拼接数据集

Towards Effective Image Forensics via A Novel Computationally Efficient Framework and A New Image Splice Dataset

Delhi Technological University(德里理工大学)

Ankit Yadav, Dinesh Kumar Vishwakarma

AI总结:

本文针对图像拼接检测数据集匮乏和计算成本高的问题,提出了一个含代码生成与手动编辑两种变体的新型拼接数据集,并设计了一种双分支时空-压缩轻量级检测框架,在复合数据集上取得0.9382的最佳准确率。

摘要:

拼接检测模型是当前迫切需要的,因为拼接篡改可被用于误导、传播谣言和制造社会不和谐。然而,图像拼接数据集严重缺乏,这限制了深度学习模型在不发生过拟合的情况下提取判别性特征的能力。本文对拼接检测做出了两方面贡献。首先,提出了一个具有两个变体的新型拼接检测数据集。这两个变体包括通过代码生成的拼接样本和通过手动编辑生成的拼接样本。两个变体中的拼接图像均具有相应的二值掩码,以辅助定位方法。其次,提出了一种新型的时空-压缩轻量级拼接检测框架,用于以最低计算成本实现准确的拼接检测。所提出的双分支框架从轻量级空间分支中提取判别性空间特征,并利用原始分辨率压缩数据从第二个分支中提取双重压缩伪影,从而使其具有“信息保持”特性。在由所提出的数据集和CASIA v2.0数据集的图像组成的复合数据集上,将多种CNN与所提出的框架结合进行了测试。最佳模型准确率达到0.9382,并与类似的最先进方法进行了比较,证明了所提出框架的优越性。

英文摘要:

Splice detection models are the need of the hour since splice manipulations can be used to mislead, spread rumors and create disharmony in society. However, there is a severe lack of image splicing datasets, which restricts the capabilities of deep learning models to extract discriminative features without overfitting. This manuscript presents two-fold contributions toward splice detection. Firstly, a novel splice detection dataset is proposed having two variants. The two variants include spliced samples generated from code and through manual editing. Spliced images in both variants have corresponding binary masks to aid localization approaches. Secondly, a novel Spatio-Compression Lightweight Splice Detection Framework is proposed for accurate splice detection with minimum computational cost. The proposed dual-branch framework extracts discriminative spatial features from a lightweight spatial branch. It uses original resolution compression data to extract double compression artifacts from the second branch, thereby making it 'information preserving.' Several CNNs are tested in combination with the proposed framework on a composite dataset of images from the proposed dataset and the CASIA v2.0 dataset. The best model accuracy of 0.9382 is achieved and compared with similar state-of-the-art methods, demonstrating the superiority of the proposed framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑