arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.04508cs.CV
收藏

TBNet:用于通用图像操作定位的双流边界感知网络

TBNet:Two-Stream Boundary-aware Network for Generic Image Manipulation Localization

Zan Gao, Chao Sun, Zhiyong Cheng, Weili Guan, Anan Liu, Meng Wang

摘要:

发现图像中的篡改区域是机器学习和计算机视觉领域的一个研究热点。虽然已经提出了许多图像篡改定位算法,但大多数算法都只关注不同颜色空间的RGB图像,而往往忽略了包含潜在篡改线索的频率信息。在这项工作中,提出了一种新的端到端的双流边界感知网络(简称TBNet)的通用图像操作本地化,其中RGB流,频率流,和边界伪影的位置在一个统一的框架进行了探索。具体而言,我们首先设计了一个自适应频率选择模块(AFS),自适应地选择合适的频率来挖掘不一致的统计量,并消除冗余统计量的干扰。然后,提出了一种自适应交叉注意融合模块(ACF),自适应融合RGB特征和频率特征。最后,边界伪影定位网络(BAL)被设计为定位的边界伪影的参数是由ACF的输出联合更新,其结果被进一步馈送到解码器。因此,RGB流、频率流和边界伪影定位网络的参数被联合优化,并且它们的潜在互补关系被充分挖掘。在四个公共基准的图像操作定位任务,即CASIA1.0,COVER,Carvalho和在野外,进行了广泛的实验结果表明,所提出的TBNet可以显着优于最先进的通用图像操作定位方法在MCC和F1。

英文摘要:

Finding tampered regions in images is a hot research topic in machine learning and computer vision. Although many image manipulation location algorithms have been proposed, most of them only focus on the RGB images with different color spaces, and the frequency information that contains the potential tampering clues is often ignored. In this work, a novel end-to-end two-stream boundary-aware network (abbreviated as TBNet) is proposed for generic image manipulation localization in which the RGB stream, the frequency stream, and the boundary artifact location are explored in a unified framework. Specifically, we first design an adaptive frequency selection module (AFS) to adaptively select the appropriate frequency to mine inconsistent statistics and eliminate the interference of redundant statistics. Then, an adaptive cross-attention fusion module (ACF) is proposed to adaptively fuse the RGB feature and the frequency feature. Finally, the boundary artifact location network (BAL) is designed to locate the boundary artifacts for which the parameters are jointly updated by the outputs of the ACF, and its results are further fed into the decoder. Thus, the parameters of the RGB stream, the frequency stream, and the boundary artifact location network are jointly optimized, and their latent complementary relationships are fully mined. The results of extensive experiments performed on four public benchmarks of the image manipulation localization task, namely, CASIA1.0, COVER, Carvalho, and In-The-Wild, demonstrate that the proposed TBNet can significantly outperform state-of-the-art generic image manipulation localization methods in terms of both MCC and F1.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑