arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1707.03124cs.CV
收藏

对抗性生成训练样本:在运动车辆牌照识别中的应用

Adversarial Generation of Training Examples: Applications to Moving Vehicle License Plate Recognition

College of Electronic and Information Engineering, Tongji University(同济大学电子与信息工程学院);School of Computer Science, The University of Adelaide(阿德莱德大学计算机科学学院)

Xinlong Wang, Zhipeng Man, Mingyu You, Chunhua Shen

摘要:

生成对抗网络(GAN)最近吸引了很多研究关注,导致自然图像生成令人印象深刻的结果。然而,迄今为止,在使用GAN生成的图像来改进分类任务方面几乎没有观察到成功。在这里,我们试图探索,在汽车牌照识别的背景下,是否有可能使用GAN生成合成训练数据,以提高识别精度。通过精心设计的管道,我们表明答案是肯定的。首先,使用GAN的生成器生成大规模图像集,而无需手动注释。然后,这些图像被输入到深度卷积神经网络(DCNN),然后输入到具有长短期记忆(LSTM)的双向循环神经网络(BRNN),执行特征学习和序列标记。最后,预训练的模型在真实图像上进行微调。我们在几个数据集上的实验结果证明了使用GAN图像的有效性:在中等大小的真实数据可用的情况下,比强基线提高了7.5%。我们表明,该框架实现了具有挑战性的测试数据集上的竞争力的识别精度。我们还利用独立卷积来构建一个轻量级的卷积RNN,它的大小约为一半,CPU速度快2倍。结合这个框架和建议的管道,我们在移动和嵌入式设备上进行准确的识别方面取得了进展。

英文摘要:

Generative Adversarial Networks (GAN) have attracted much research attention recently, leading to impressive results for natural image generation. However, to date little success was observed in using GAN generated images for improving classification tasks. Here we attempt to explore, in the context of car license plate recognition, whether it is possible to generate synthetic training data using GAN to improve recognition accuracy. With a carefully-designed pipeline, we show that the answer is affirmative. First, a large-scale image set is generated using the generator of GAN, without manual annotation. Then, these images are fed to a deep convolutional neural network (DCNN) followed by a bidirectional recurrent neural network (BRNN) with long short-term memory (LSTM), which performs the feature learning and sequence labelling. Finally, the pre-trained model is fine-tuned on real images. Our experimental results on a few data sets demonstrate the effectiveness of using GAN images: an improvement of 7.5% over a strong baseline with moderate-sized real data being available. We show that the proposed framework achieves competitive recognition accuracy on challenging test datasets. We also leverage the depthwise separate convolution to construct a lightweight convolutional RNN, which is about half size and 2x faster on CPU. Combining this framework and the proposed pipeline, we make progress in performing accurate recognition on mobile and embedded devices.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑