arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.03556cs.CV
收藏

Npix2Cpix:一种用于历史文档图像水印检索的、集成检索-分类的基于GAN的图像到图像翻译网络

Npix2Cpix: A GAN-Based Image-to-Image Translation Network With Retrieval- Classification Integration for Watermark Retrieval From Historical Document Images

BRAC University(BRAC大学);The University of Texas at Dallas(德克萨斯大学达拉斯分校)

Utsab Saha, Sawradip Saha, Shaikh Anowarul Fattah, Mohammad Saquib

AI总结:

针对历史文档水印分类难的问题,提出基于改进U-net的条件GAN网络Npix2Cpix做图像去噪预处理,结合孪生网络单样本分类,在大规模历史水印数据集上实现了高准确率的水印分类与检索。

摘要:

古代水印的识别与复原长期以来都是写本学与历史学领域的重要课题。由于历史文档水印具有多样性、样本含噪、存在多种表征模式,且类间差异微小、类内存在变化,基于水印对历史文档进行分类极具挑战性。本文提出一种基于改进U型网络的条件生成对抗网络(GAN),名为Npix2Cpix,通过执行从退化(含噪)像素到清晰像素的图像翻译,将含噪的原始历史水印图像转换为无手写痕迹的清晰水印图像。该网络利用图像到图像翻译与对抗学习,生成无杂波的图像,用于水印复原与分类。所提GAN的生成器与判别器采用两个独立的损失函数训练,二者均基于图像间的距离,以学习从输入含噪图像到输出清晰图像的映射。在使用所提GAN对含噪水印图像进行预处理后,采用基于Siamese(孪生网络)的单样本学习进行水印分类。在大规模历史水印数据集上的实验结果表明,对含噪水印图像进行清晰化处理有助于实现较高的单样本分类准确率。对检索到的水印图像的定性与定量评估,凸显了所提方法的有效性。

英文摘要:

The identification and restoration of ancient watermarks have long been a major topic in codicology and history. Classifying historical documents based on watermarks is challenging due to their diversity, noisy samples, multiple representation modes, and minor distinctions between classes and intra-class variations. This paper proposes a modified U-net-based conditional generative adversarial network (GAN) named Npix2Cpix to translate noisy raw historical watermarked images into clean, handwriting-free watermarked images by performing image translation from degraded (noisy) pixels to clean pixels. Using image-to-image translation and adversarial learning, the network creates clutter-free images for watermark restoration and categorization. The generator and discriminator of the proposed GAN are trained using two separate loss functions, each based on the distance between images, to learn the mapping from the input noisy image to the output clean image. After using the proposed GAN to pre-process noisy watermarked images, Siamese-based one-shot learning is employed for watermark classification. Experimental results on a large-scale historical watermark dataset demonstrate that cleaning the noisy watermarked images can help to achieve high one-shot classification accuracy. The qualitative and quantitative evaluation of the retrieved watermarked image highlights the effectiveness of the proposed approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑