arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2011.10251cs.CV
收藏

设备内置文本图像超分辨率

On-Device Text Image Super Resolution

OnDevice AI Samsung R\& D Institute Bangalore, India;2cm OnDevice AI 2cm Samsung R\& D Institute 2cm Bangalore, India 2cm

Dhruval Jain, Arun D Prabhu, Gopi Ramena, Manoj Goyal, Debi Prasanna Mohanty, Sukumar Moharana, Naresh Purre

摘要:

随着深度卷积神经网络的发展,最近对超分辨率(SR)的研究取得了重大进展。需要从设备上的场景文本图像甚至文档图像中提取信息抽取,其中大多数是低分辨率(LR)图像。因此,SR成为必不可少的预处理步骤,因为传统上存在于智能手机中的双三次上采样在LR图像上表现不佳。为了让用户更好地控制自己的隐私,并通过减少云计算的开销和GPU使用时间来减少碳足迹,在边缘上执行SR模型是最近一段时间的必要条件。在智能手机等资源受限的平台上运行和优化模型存在各种挑战。在本文中,我们提出了一种新的深度神经网络,它可以重建更清晰的字符边缘,从而提高OCR的置信度。所提出的架构不仅在各种基准数据集上实现了比双三次上采样的PSNR的显着改善,而且还以每幅图像11.7 ms的平均推理时间运行。我们在Text330数据集上的表现优于最先进的技术。我们还在ICDAR 2015 TextSR数据集上实现了75.89%的OCR准确率,其中地面真实值的准确率为78.10%。

英文摘要:

Recent research on super-resolution (SR) has witnessed major developments with the advancements of deep convolutional neural networks. There is a need for information extraction from scenic text images or even document images on device, most of which are low-resolution (LR) images. Therefore, SR becomes an essential pre-processing step as Bicubic Upsampling, which is conventionally present in smartphones, performs poorly on LR images. To give the user more control over his privacy, and to reduce the carbon footprint by reducing the overhead of cloud computing and hours of GPU usage, executing SR models on the edge is a necessity in the recent times. There are various challenges in running and optimizing a model on resource-constrained platforms like smartphones. In this paper, we present a novel deep neural network that reconstructs sharper character edges and thus boosts OCR confidence. The proposed architecture not only achieves significant improvement in PSNR over bicubic upsampling on various benchmark datasets but also runs with an average inference time of 11.7 ms per image. We have outperformed state-of-the-art on the Text330 dataset. We also achieve an OCR accuracy of 75.89% on the ICDAR 2015 TextSR dataset, where ground truth has an accuracy of 78.10%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑