arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.13018cs.CV
收藏

注意力和预测引导的低对比度运动小目标检测

Attention and Prediction Guided Motion Detection for Low-Contrast Small Moving Targets

Guangzhou University(广州大学);University of Lincoln(林肯大学);Guangxi University(广西大学);Northwest Institute of Mechanical and Electrical Engineering(西北机电工程研究所)

Hongxin Wang, Jiannan Zhao, Huatian Wang, Cheng Hu, Jigen Peng, Shigang Yue

摘要:

复杂自然环境中的小目标运动检测是自主机器人的一项极具挑战性的任务。令人惊讶的是,昆虫的视觉系统已经进化到在发现配偶和跟踪猎物方面非常有效,即使目标占据了它们视野的几度。对小目标运动的出色灵敏度依赖于一类称为小目标运动检测器(STMD)的专门神经元。然而,现有的基于STMD的模型严重依赖于视觉对比度,并且在复杂的自然环境中表现不佳,在复杂的自然环境中,小目标通常与相邻背景的对比度极低。在本文中,我们开发了一个注意和预测引导的视觉系统,以克服这一限制。开发的视觉系统包括三个主要的子系统,即,注意模块,基于STMD的神经网络,和预测模块。注意力模块在输入图像的预测区域中搜索潜在的小目标,并增强它们与复杂背景的对比度。基于STMD的神经网络接收对比度增强的图像,并从背景假阳性中区分小的运动目标。预测模块预见检测到的目标的未来位置,并为注意力模块生成预测图。这三个子系统连接在一个经常性的架构,允许信息被顺序处理,以激活特定区域的小目标检测。合成和真实世界的数据集上的大量实验表明,所提出的视觉系统的有效性和优越性,检测小,低对比度的运动目标对复杂的自然环境。

英文摘要:

Small target motion detection within complex natural environments is an extremely challenging task for autonomous robots. Surprisingly, the visual systems of insects have evolved to be highly efficient in detecting mates and tracking prey, even though targets occupy as small as a few degrees of their visual fields. The excellent sensitivity to small target motion relies on a class of specialized neurons called small target motion detectors (STMDs). However, existing STMD-based models are heavily dependent on visual contrast and perform poorly in complex natural environments where small targets generally exhibit extremely low contrast against neighbouring backgrounds. In this paper, we develop an attention and prediction guided visual system to overcome this limitation. The developed visual system comprises three main subsystems, namely, an attention module, an STMD-based neural network, and a prediction module. The attention module searches for potential small targets in the predicted areas of the input image and enhances their contrast against complex background. The STMD-based neural network receives the contrast-enhanced image and discriminates small moving targets from background false positives. The prediction module foresees future positions of the detected targets and generates a prediction map for the attention module. The three subsystems are connected in a recurrent architecture allowing information to be processed sequentially to activate specific areas for small target detection. Extensive experiments on synthetic and real-world datasets demonstrate the effectiveness and superiority of the proposed visual system for detecting small, low-contrast moving targets against complex natural environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑