arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.10092cs.CV
收藏

基于运动先验的交通视频目标检测

Traffic Video Object Detection using Motion Prior

University of Cambridge(剑桥大学);Microsoft Cloud + AI(微软云与人工智能);GSK(葛兰素史克)

Lihao Liu, Yanqi Cheng, Dongdong Chen, Jing He, Pietro Liò, Carola-Bibiane Schönlieb, Angelica I Aviles-Rivero

AI总结:

针对交通视频固定摄像头提供的运动先验未被利用的问题,提出基于运动先验的自注意力模块和伪标签机制,分别提升全监督与半监督检测性能,mAP超越现有方法2%。

摘要:

交通视频与普通视频在本质上有所不同,因为其摄像头通常是固定不动的,从而提供了强大的运动先验,即物体在短时间内往往沿特定方向移动。现有工作主要采用通用视频目标检测框架来处理交通视频目标检测,这带来了诸如广泛适用性和对多样场景的鲁棒性等优势。然而,这些方法未能利用运动先验来提升检测精度。在本工作中,我们提出了两种创新方法来利用运动先验,并提升全监督和半监督交通视频目标检测的性能。首先,我们引入了一种新的自注意力模块,该模块利用运动先验在全监督设置下指导时间信息整合。其次,我们利用运动先验开发了一种伪标签机制,以消除半监督设置中的噪声伪标签。我们这两种以运动先验为中心的方法均持续展现出优越的性能,在mAP指标上以2%的幅度超越了现有最先进的方法。

英文摘要:

Traffic videos inherently differ from generic videos in their stationary camera setup, thus providing a strong motion prior where objects often move in a specific direction over a short time interval. Existing works predominantly employ generic video object detection framework for traffic video object detection, which yield certain advantages such as broad applicability and robustness to diverse scenarios. However, they fail to harness the strength of motion prior to enhance detection accuracy. In this work, we propose two innovative methods to exploit the motion prior and boost the performance of both fully-supervised and semi-supervised traffic video object detection. Firstly, we introduce a new self-attention module that leverages the motion prior to guide temporal information integration in the fully-supervised setting. Secondly, we utilise the motion prior to develop a pseudo-labelling mechanism to eliminate noisy pseudo labels for the semi-supervised setting. Both of our motion-prior-centred methods consistently demonstrates superior performance, outperforming existing state-of-the-art approaches by a margin of 2% in terms of mAP.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑