基于深度学习的文档图像伪造攻击
Deep Learning-based Forgery Attack on Document Images
摘要:
随着在线服务的不断普及,数字文档图像已经被用于各种应用中。同时,出现了一些基于深度学习的文本编辑算法,其改变图像的文本信息。在这项工作中,我们提出了一个文件伪造算法来编辑实际的文件图像。针对现有文本编辑算法在处理复杂字符和复杂背景时的局限性,提出了一套网络设计策略。首先,通过分离源图像中的文本和背景信息来避免监督数据中不必要的混淆。第二,为了捕捉一些复杂的组件的结构,文本骨架作为辅助信息,并在损失函数中显式地考虑纹理的连续性。第三,由文本编辑操作引起的伪造痕迹通过一些后处理操作来减轻,这些后处理操作考虑了来自打印和扫描通道的失真。定量比较所提出的方法和现有的方法表明,我们的设计的优点,通过减少约2/3的重建误差测量的MSE,提高重建质量测量的PSNR和SSIM的4 dB和0.21,分别。定性实验证实,该方法的重建结果在视觉上优于现有的方法。更重要的是,我们已经证明了一个实际的情况下,攻击者能够改变在一个身份文件中的文本信息,只使用一个样本在目标域中的文件伪造算法的性能。由所提出的文本编辑攻击和重新捕获操作创建的伪造并重新捕获的样本已经成功地欺骗了一些现有的文档认证系统。
英文摘要:
With the ongoing popularization of online services, the digital document images have been used in various applications. Meanwhile, there have emerged some deep learning-based text editing algorithms which alter the textual information of an image . In this work, we present a document forgery algorithm to edit practical document images. To achieve this goal, the limitations of existing text editing algorithms towards complicated characters and complex background are addressed by a set of network design strategies. First, the unnecessary confusion in the supervision data is avoided by disentangling the textual and background information in the source images. Second, to capture the structure of some complicated components, the text skeleton is provided as auxiliary information and the continuity in texture is considered explicitly in the loss function. Third, the forgery traces induced by the text editing operation are mitigated by some post-processing operations which consider the distortions from the print-and-scan channel. Quantitative comparisons of the proposed method and the exiting approach have shown the advantages of our design by reducing the about 2/3 reconstruction error measured in MSE, improving reconstruction quality measured in PSNR and in SSIM by 4 dB and 0.21, respectively. Qualitative experiments have confirmed that the reconstruction results of the proposed method are visually better than the existing approach. More importantly, we have demonstrated the performance of the proposed document forgery algorithm under a practical scenario where an attacker is able to alter the textual information in an identity document using only one sample in the target domain. The forged-and-recaptured samples created by the proposed text editing attack and recapturing operation have successfully fooled some existing document authentication systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。