arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.10252cs.CV
收藏

DocEnTr:一个端到端的文档图像增强Transformer

DocEnTr: An End-to-End Document Image Enhancement Transformer

Computer Vision Center Universitat Autònoma de Barcelona(巴塞罗那自治大学计算机视觉中心);Digital Research Center of Sfax(斯法克斯数字研究中心);University of Sfax(斯法克斯大学);Indian Statistical Institute(印度统计研究所)

Mohamed Ali Souibgui, Sanket Biswas, Sana Khamekhem Jemni, Yousri Kessentini, Alicia Fornés, Josep Lladós, Umapada Pal

摘要:

文档图像可能会受到许多退化场景的影响,这会导致识别和处理困难。在这个数字化的时代,为了正确使用,对它们进行降噪是很重要的。为了解决这一挑战,我们提出了一种新的编码器-解码器架构的基础上视觉Transformer,以提高机器打印和手写文档图像,在一个端到端的方式。编码器直接在像素块上操作它们的位置信息,而不使用任何卷积层,而解码器从编码的块重建干净的图像。进行的实验表明,该模型的优越性相比,国家的最先进的方法在几个DIBCO基准。代码和模型将在以下网址公开:\url{https://github.com/dali92002/DocEnTR}。

英文摘要:

Document images can be affected by many degradation scenarios, which cause recognition and processing difficulties. In this age of digitization, it is important to denoise them for proper usage. To address this challenge, we present a new encoder-decoder architecture based on vision transformers to enhance both machine-printed and handwritten document images, in an end-to-end fashion. The encoder operates directly on the pixel patches with their positional information without the use of any convolutional layers, while the decoder reconstructs a clean image from the encoded patches. Conducted experiments show a superiority of the proposed model compared to the state-of the-art methods on several DIBCO benchmarks. Code and models will be publicly available at: \url{https://github.com/dali92002/DocEnTR}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑