arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.15488cs.CV
收藏

基于跟踪的场景文本视频半自动标注

Tracking Based Semi-Automatic Annotation for Scene Text Videos

Shanghai University(上海大学);Shanghai Institute for Advanced Communication and Data Science(上海先进通信与数据科学研究院)

Jiajun Zhu, Xiufeng Jiang, Zhiwei Jia, Shugong Xu, Shan Cao

摘要:

近年来,视频场景文本检测因其广泛的应用而受到越来越多的关注。然而,缺乏带注释的场景文本视频数据集已成为阻碍视频场景文本检测发展的重要问题之一。现有的场景文本视频数据集由于人工标注成本昂贵,规模不大。此外,这些数据集中的文本实例太清楚了,不构成挑战。针对上述问题,本文提出了一种基于跟踪的场景文本视频半自动标注策略。通过对第一帧进行人工标注,对后续帧进行自动跟踪,实现了半自动的场景文本标注,避免了人工标注的巨大开销。此外,提出了一个成对的低质量场景文本视频数据集,名为Text-RBL,由原始视频,模糊视频,低分辨率视频,所提出的方便的半自动标记策略标记。通过对原始视频的平均操作和双三次下采样操作,我们可以有效地获得与原始视频配对的模糊视频和低分辨率视频。为了验证Text-RBL的有效性,我们提出了一个基线模型结合文本检测器和跟踪器的视频场景文本检测。此外,故障检测方案的设计,以减轻基线模型的漂移问题所造成的复杂场景。大量的实验表明,Text-RBL与配对的低质量视频标记的半自动方法可以显着提高低质量场景中的文本检测器的性能。

英文摘要:

Recently, video scene text detection has received increasing attention due to its comprehensive applications. However, the lack of annotated scene text video datasets has become one of the most important problems, which hinders the development of video scene text detection. The existing scene text video datasets are not large-scale due to the expensive cost caused by manual labeling. In addition, the text instances in these datasets are too clear to be a challenge. To address the above issues, we propose a tracking based semi-automatic labeling strategy for scene text videos in this paper. We get semi-automatic scene text annotation by labeling manually for the first frame and tracking automatically for the subsequent frames, which avoid the huge cost of manual labeling. Moreover, a paired low-quality scene text video dataset named Text-RBL is proposed, consisting of raw videos, blurry videos, and low-resolution videos, labeled by the proposed convenient semi-automatic labeling strategy. Through an averaging operation and bicubic down-sampling operation over the raw videos, we can efficiently obtain blurry videos and low-resolution videos paired with raw videos separately. To verify the effectiveness of Text-RBL, we propose a baseline model combined with the text detector and tracker for video scene text detection. Moreover, a failure detection scheme is designed to alleviate the baseline model drift issue caused by complex scenes. Extensive experiments demonstrate that Text-RBL with paired low-quality videos labeled by the semi-automatic method can significantly improve the performance of the text detector in low-quality scenes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑