arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.09429cs.CV
收藏

NU-AIR——用于行人和车辆检测与定位的神经形态城市航空数据集

NU-AIR -- A Neuromorphic Urban Aerial Dataset for Detection and Localization of Pedestrians and Vehicles

New Jersey Institute of Technology(新泽西理工学院)

Craig Iaboni, Thomas Kelly, Pramod Abichandani

AI总结:

本文提出开源城市航空神经形态数据集NU-AIR,包含70.75分钟事件录像及93,204个行人和车辆标注,并通过SNN消融实验和DNN训练验证其质量与可靠性。

摘要:

本文提出了一个开源的航空神经形态数据集,用于捕捉城市环境中移动的行人和车辆。该数据集名为NU-AIR,包含70.75分钟的事件录像,由安装在四旋翼飞行器上的640 x 480分辨率神经形态传感器在城市环境中采集。数据集中记录了不同高度和光照条件下的人群、不同类型的车辆以及繁忙的城市街景。录像中的车辆和行人以30 Hz的频率提供手动边界框标注,共产生93,204个标签。通过三个脉冲神经网络(SNNs)的综合消融研究以及训练十个深度神经网络(DNNs)来评估数据集的保真度,以验证数据集及相应标注的质量和可靠性。所有数据以及用于体素化数据并随后训练SNNs/DNNs的Python代码均已开源。

英文摘要:

This paper presents an open-source aerial neuromorphic dataset that captures pedestrians and vehicles moving in an urban environment. The dataset, titled NU-AIR, features 70.75 minutes of event footage acquired with a 640 x 480 resolution neuromorphic sensor mounted on a quadrotor operating in an urban environment. Crowds of pedestrians, different types of vehicles, and street scenes featuring busy urban environments are captured at different elevations and illumination conditions. Manual bounding box annotations of vehicles and pedestrians contained in the recordings are provided at a frequency of 30 Hz, yielding 93,204 labels in total. Evaluation of the dataset's fidelity is performed through comprehensive ablation study for three Spiking Neural Networks (SNNs) and training ten Deep Neural Networks (DNNs) to validate the quality and reliability of both the dataset and corresponding annotations. All data and Python code to voxelize the data and subsequently train SNNs/DNNs has been open-sourced.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑