arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.12436cs.CV
收藏

所有你需要的是第二次看:迈向更紧密的任意形状文本检测

All you need is a second look: Towards Tighter Arbitrary shape text detection

Peking University(北京大学);Peng Cheng Laboratory(鹏城实验室)

Meng Cao, Yuexian Zou

摘要:

基于深度学习的场景文本检测方法在过去几年中取得了实质性进展。然而,仍有几个问题有待解决。通常,由于CNN的有限感受野大小,长曲线文本实例往往是碎片化的。此外,使用矩形或四边形包围盒的简单表示在处理更具挑战性的任意形状的文本时显得不足。此外,文本实例的规模变化很大,这导致难以通过单个分割网络进行准确预测。为了解决这些问题,我们创新性地提出了一个两阶段分割为基础的任意文本检测器命名为\textit{NASK}(\textbf{N}需要\textbf{A} \textbf{S} econd loo \textbf{K})。具体而言,\textit{NASK}由文本实例分割网络(即\textit{TIS}(\(1^{st}\)阶段))、文本RoI池化模块和基准点表达模块(称为\textit{FOX}(\(2^{nd}\)阶段))组成。首先,\textit{TIS}进行实例分割,以获得矩形文本建议与建议的组空间和通道注意力模块(\textit{GSCA}),以增加的特征表达。然后,文本RoI池将这些矩形转换为固定大小。最后,\textit{FOX}被引入到重建文本实例与更紧密的表示使用预测的几何属性,包括文本中心线,文本行方向,字符比例尺和字符方向。在\textit{Total-Text}和\textit{SCUT-CTW1500}两个公共基准上的实验结果表明,所提出的\textit{NASK}达到了最先进的效果.

英文摘要:

Deep learning-based scene text detection methods have progressed substantially over the past years. However, there remain several problems to be solved. Generally, long curve text instances tend to be fragmented because of the limited receptive field size of CNN. Besides, simple representations using rectangle or quadrangle bounding boxes fall short when dealing with more challenging arbitrary-shaped texts. In addition, the scale of text instances varies greatly which leads to the difficulty of accurate prediction through a single segmentation network. To address these problems, we innovatively propose a two-stage segmentation based arbitrary text detector named \textit{NASK} (\textbf{N}eed \textbf{A} \textbf{S}econd loo\textbf{K}). Specifically, \textit{NASK} consists of a Text Instance Segmentation network namely \textit{TIS} (\(1^{st}\) stage), a Text RoI Pooling module and a Fiducial pOint eXpression module termed as \textit{FOX} (\(2^{nd}\) stage). Firstly, \textit{TIS} conducts instance segmentation to obtain rectangle text proposals with a proposed Group Spatial and Channel Attention module (\textit{GSCA}) to augment the feature expression. Then, Text RoI Pooling transforms these rectangles to the fixed size. Finally, \textit{FOX} is introduced to reconstruct text instances with a more tighter representation using the predicted geometrical attributes including text center line, text line orientation, character scale and character orientation. Experimental results on two public benchmarks including \textit{Total-Text} and \textit{SCUT-CTW1500} have demonstrated that the proposed \textit{NASK} achieves state-of-the-art results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑