State-of-the-art document dewarping techniques learn to predict 3-dimensional information of documents which are prone to errors while dealing with documents with irregular distortions or large variations in depth. This paper presents FDRNet, a Fourier Document Restoration Network that can restore documents with different distortions and improve document recognition in a reliable and simpler manner. FDRNet focuses on high-frequency components in the Fourier space that capture most structural information but are largely free of degradation in appearance. It dewarps documents by a flexible Thin-Plate Spline transformation which can handle various deformations effectively without requiring deformation annotations in training. These features allow FDRNet to learn from a small amount of simply labeled training images, and the learned model can dewarp documents with complex geometric distortion and recognize the restored texts accurately. To facilitate document restoration research, we create a benchmark dataset consisting of over one thousand camera documents with different types of geometric and photometric distortion. Extensive experiments show that FDRNet outperforms the state-of-the-art by large margins on both dewarping and text recognition tasks. In addition, FDRNet requires a small amount of simply labeled training data and is easy to deploy.
Institute of Information Engineering, Chinese Academy of Sciences;VCIP \& TMCC \& DISSec, College of Computer Science \& College of Cryptology;Cyber Science, Nankai University;School of Cyber Security, University of Chinese Academy of Sciences
Dewarping Document Image By Displacement Flow Estimation with Fully Convolutional Network
University of Chinese Academy of Sciences(中国科学院大学);Institute of Automation of Chinese Academy of Sciences(中国科学院自动化研究所);CAS Center for Excellence of Brain Science and Intelligence Technology(中国科学院脑科学与智能技术卓越创新中心)
Marior: Margin Removal and Iterative Content Rectification for Document Dewarping in the Wild
South China University of Technology(华南理工大学);Peng Cheng Laboratory(鹏城实验室);Pazhou Laboratory (Huangpu)(琶洲实验室(黄埔));IntSig Information Co. Ltd(合合信息科技股份有限公司)
DocPure: Prompt-Free Unified Document Restoration via Degradation-Aware Structure-Guided Wavelet Modulation
College of Computer Science and Artificial Intelligence, Wenzhou University(温州大学计算机与人工智能学院);AI Analytics Team, Nasdaq(纳斯达克人工智能分析团队);vivo Mobile Communication Co., Ltd(维沃移动通信有限公司);College of Engineering and Computer Science, The Australian National University(澳大利亚国立大学工程与计算机科学学院)
DDVR-Net: Degradation-Aware Decoupling and Visibility-Guided Restoration for Historical Document Recognition
Institute of National Security, Minzu University of China(中央民族大学国家安全研究院);School of Information Engineering, Minzu University of China(中央民族大学信息工程学院);School of Artificial Intelligence and Computer Science, North China University of Technology(北方工业大学人工智能与计算机学院)
Uni-DocDiff: A Unified Document Restoration Model Based on Diffusion
Institute of Information Engineering, Chinese Academy of Sciences School of Cyber Security, University of Chinese Academy of Sciences Beijing China;Institute of Information Engineering, Chinese Academy of Sciences Beijing China;Binghamton University Binghamton US;Minzu University of China Beijing China;VCIP \& TMCC \& DISSec, College of Computer Science, Nankai University Tianjin China;Institute of Information Engineering, Chinese Academy of Sciences;School of Cyber Security, University of Chinese Academy of Sciences;Binghamton University;Minzu University of China;VCIP \& TMCC \& DISSec, College of Computer Science, Nankai University
Beyond pixels and regions: A non local patch means (NLPM) method for content-level restoration, enhancement, and reconstruction of degraded document images
Reviving Cultural Heritage: A Novel Approach for Comprehensive Historical Document Restoration
South China University of Technology(南方科技大学);Intsig Information Co., Ltd.(Intsig信息有限公司);INTSIG-SCUT Joint Lab on Document Analysis and Recognition(INTSIG-SCUT文档分析与识别联合实验室);SCUT-Zhuhai Institute of Modern Industrial Innovation(南方科技大学珠海现代工业创新研究院)
Npix2Cpix: A GAN-Based Image-to-Image Translation Network With Retrieval- Classification Integration for Watermark Retrieval From Historical Document Images
BRAC University(BRAC大学);The University of Texas at Dallas(德克萨斯大学达拉斯分校)