arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.05078cs.CV
收藏

汽车挡风玻璃上雨滴的数据集及轻量化检测算法

Raindrops on Windshield: Dataset and Lightweight Gradient-Based Detection Algorithm

Evocargo LLC(Evocargo有限责任公司);Institute for Information Transmission Problems(信息传输问题研究所);Moscow Institute of Physics and Technology (National Research University)(莫斯科物理技术学院(国家研究型大学))

Vera Soboleva, Oleg Shipitko

摘要:

自动驾驶汽车使用摄像头作为环境信息的主要来源之一。不利的天气条件,如雨滴、雪、泥等,可能导致各种图像伪影。这种伪影显著降低了所获得的视觉数据的质量和可靠性,并且如果不及时检测到它们,则可能导致事故。本文介绍了一个新的数据集正在进行的工作,用于训练和评估视觉算法的性能,用于相机镜头或挡风玻璃上的图像伪影检测的不同任务。目前,我们提出了一个公开的图像集包含$8190$图像,其中$3390$包含雨滴。图像注释与二进制掩模表示区域与雨滴。我们证明了数据集的雨滴存在检测和雨滴区域分割的问题的适用性。为了增加数据,我们还提出了一个算法,数据增强,它允许生成的图像上的合成雨滴。除了数据集,我们提出了一种新的基于梯度的算法在视频序列中的雨滴存在检测。实验结果表明,该算法能够可靠地检测雨滴。此外,与基于互相关的\cite{Einecke2014}算法相比,该算法具有更高的雨滴检测质量和图像处理速度,适用于实际自主系统的自检过程。数据集可在\href{https://github.com/EvoCargo/RaindropsOnWindshield}{$github.com/EvoCargo/RaindropsOnWindshield$}上获得。

英文摘要:

Autonomous vehicles use cameras as one of the primary sources of information about the environment. Adverse weather conditions such as raindrops, snow, mud, and others, can lead to various image artifacts. Such artifacts significantly degrade the quality and reliability of the obtained visual data and can lead to accidents if they are not detected in time. This paper presents ongoing work on a new dataset for training and assessing vision algorithms' performance for different tasks of image artifacts detection on either camera lens or windshield. At the moment, we present a publicly available set of images containing $8190$ images, of which $3390$ contain raindrops. Images are annotated with the binary mask representing areas with raindrops. We demonstrate the applicability of the dataset in the problems of raindrops presence detection and raindrop region segmentation. To augment the data, we also propose an algorithm for data augmentation which allows the generation of synthetic raindrops on images. Apart from the dataset, we present a novel gradient-based algorithm for raindrop presence detection in a video sequence. The experimental evaluation proves that the algorithm reliably detects raindrops. Moreover, compared with the state-of-the-art cross-correlation-based algorithm \cite{Einecke2014}, the proposed algorithm showed a higher quality of raindrop presence detection and image processing speed, making it applicable for the self-check procedure of real autonomous systems. The dataset is available at \href{https://github.com/EvoCargo/RaindropsOnWindshield}{$github.com/EvoCargo/RaindropsOnWindshield$}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑