arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2203.09910cs.CV
收藏

基于傅立叶文档复原的鲁棒文档去畸变与识别

Fourier Document Restoration for Robust Document Dewarping and Recognition

Nanyang Technological University(南洋理工大学);ByteDance(字节跳动)

Chuhui Xue, Zichen Tian, Fangneng Zhan, Shijian Lu, Song Bai

摘要:

最先进的文档去扭曲技术学习预测文档的3维信息,当处理具有不规则失真或深度变化大的文档时,这些文档容易出错。本文介绍了FDRNet,一个傅立叶文档恢复网络,可以恢复不同失真的文档,并以可靠和简单的方式提高文档识别。FDRNet专注于傅立叶空间中的高频分量,这些分量捕获了大多数结构信息,但在外观上基本上没有退化。它通过一个灵活的薄板样条变换,可以有效地处理各种变形,而不需要在训练中变形注释的文件去扭曲。这些特征允许FDRNet从少量简单标记的训练图像中学习,学习的模型可以对具有复杂几何失真的文档进行变形,并准确识别恢复的文本。为了便于文档恢复研究,我们创建了一个基准数据集,由一千多个具有不同类型的几何和光度失真的相机文档组成。大量的实验表明,FDRNet在去扭曲和文本识别任务上的性能都大大优于最先进的技术。此外,FDRNet只需要少量简单标记的训练数据,易于部署。

英文摘要:

State-of-the-art document dewarping techniques learn to predict 3-dimensional information of documents which are prone to errors while dealing with documents with irregular distortions or large variations in depth. This paper presents FDRNet, a Fourier Document Restoration Network that can restore documents with different distortions and improve document recognition in a reliable and simpler manner. FDRNet focuses on high-frequency components in the Fourier space that capture most structural information but are largely free of degradation in appearance. It dewarps documents by a flexible Thin-Plate Spline transformation which can handle various deformations effectively without requiring deformation annotations in training. These features allow FDRNet to learn from a small amount of simply labeled training images, and the learned model can dewarp documents with complex geometric distortion and recognize the restored texts accurately. To facilitate document restoration research, we create a benchmark dataset consisting of over one thousand camera documents with different types of geometric and photometric distortion. Extensive experiments show that FDRNet outperforms the state-of-the-art by large margins on both dewarping and text recognition tasks. In addition, FDRNet requires a small amount of simply labeled training data and is easy to deploy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑