arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.05058cs.CVcs.AIeess.IV
收藏

一种360度多摄像头系统用于蓝色应急灯检测,采用颜色关注RT-DETR和ABLDataset

A 360-degree Multi-camera System for Blue Emergency Light Detection Using Color Attention RT-DETR and the ABLDataset

Institute of Telecommunications and Multimedia Applications, Universitat Politècnica de València(电信与多媒体应用研究所,巴塞罗那理工大学)

Francisco Vacalebri-Lloret, Lucas Banchero, Jose J. Lopez, Jose M. Mossi

AI总结:

本文提出一种基于颜色关注RT-DETR和ABLDataset的360度多摄像头系统,用于检测应急车辆蓝色灯光,实现高准确率和召回率,提升ADAS和道路安全性能。

摘要:

本研究提出了一种先进的系统,用于检测应急车辆上的蓝色灯光,该系统使用ABLDataset,这是一个经过精心编排的数据集,包含在各种气候和地理条件下欧洲应急车辆的图像。该系统采用四个鱼眼摄像头的配置,每个摄像头具有180度的水平视野,安装在车辆两侧。校准过程使检测能够实现方位定位。此外,还对主要深度神经网络算法进行了比较分析,包括YOLO(v5、v8和v10)、RetinaNet、Faster R-CNN和RT-DETR。RT-DETR被选为基模型,并通过引入颜色关注模块进行增强,在测试集上实现了94.7%的准确率和94.1%的召回率,现场检测距离可达70米。此外,该系统利用几何变换估计应急车辆相对于车辆中心的接近角度。该系统设计用于整合到结合视觉和声音数据的多模态系统中,已显示出高效性,为增强高级驾驶辅助系统(ADAS)和道路安全提供了有前景的方法。

英文摘要:

This study presents an advanced system for detecting blue lights on emergency vehicles, developed using ABLDataset, a curated dataset that includes images of European emergency vehicles under various climatic and geographic conditions. The system employs a configuration of four fisheye cameras, each with a 180-degree horizontal field of view, mounted on the sides of the vehicle. A calibration process enables the azimuthal localization of the detections. Additionally, a comparative analysis of major deep neural network algorithms was conducted, including YOLO (v5, v8, and v10), RetinaNet, Faster R-CNN, and RT-DETR. RT-DETR was selected as the base model and enhanced through the incorporation of a color attention block, achieving an accuracy of 94.7 percent and a recall of 94.1 percent on the test set, with field test detections reaching up to 70 meters. Furthermore, the system estimates the approach angle of the emergency vehicle relative to the center of the car using geometric transformations. Designed for integration into a multimodal system that combines visual and acoustic data, this system has demonstrated high efficiency, offering a promising approach to enhancing Advanced Driver Assistance Systems (ADAS) and road safety.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑