arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.02136cs.CVcs.AIcs.LG
收藏

从无人机影像中提取地理参考车辆轨迹的先进计算机视觉技术

Advanced computer vision for extracting georeferenced vehicle trajectories from drone imagery

KAIST(韩国科学技术院);EPFL(苏黎世联邦理工学院)

Robert Fonod, Haechan Cho, Hwasoo Yeo, Nikolas Geroliminis

AI总结:

本文提出一种融合定制高空目标检测、轨迹稳定与地理参考策略的无人机影像车辆轨迹提取框架,并在松岛采集12TB数据构建Songdo Traffic和Songdo Vision数据集,验证了其在密集城市环境中的高精度交通监测能力。

摘要:

本文提出了一个从高空无人机影像中提取地理参考车辆轨迹的框架,旨在应对城市交通监测中的关键挑战以及传统地面系统的局限性。我们的方法整合了多项新颖贡献,包括一个针对高空鸟瞰视角优化的定制目标检测器、一种独特的轨迹稳定方法,该方法在图像配准过程中使用检测到的车辆边界框作为排除掩码,以及一种基于正射影像和主帧的地理参考策略,该策略增强了多个无人机视角之间的一致对齐。此外,我们的框架具备稳健的车辆尺寸估计和精细的道路分割能力,能够支持全面的交通分析。该研究在韩国松岛国际商务区进行,采用多无人机实验覆盖20个交叉口,在四天内采集了约12TB的4K视频数据。该框架生成了两个高质量数据集:Songdo Traffic数据集,包含约700,000条唯一车辆轨迹;Songdo Vision数据集,包含超过5,000张人工标注图像,涵盖四个类别中约300,000个车辆实例。与来自一辆装有高精度传感器的探测车的传感器数据进行比较,凸显了我们的提取流程在密集城市环境中的准确性和一致性。Songdo Traffic和Songdo Vision的公开发布,以及提取流程的完整源代码,在交通研究的数据质量、可复现性和可扩展性方面建立了新的基准。结果表明,将无人机技术与先进计算机视觉相结合,用于精确且具有成本效益的城市交通监测具有巨大潜力,为开发智能交通系统和增强交通管理策略提供了宝贵资源。

英文摘要:

This paper presents a framework for extracting georeferenced vehicle trajectories from high-altitude drone imagery, addressing key challenges in urban traffic monitoring and the limitations of traditional ground-based systems. Our approach integrates several novel contributions, including a tailored object detector optimized for high-altitude bird's-eye view perspectives, a unique track stabilization method that uses detected vehicle bounding boxes as exclusion masks during image registration, and an orthophoto and master frame-based georeferencing strategy that enhances consistent alignment across multiple drone viewpoints. Additionally, our framework features robust vehicle dimension estimation and detailed road segmentation, enabling comprehensive traffic analysis. Conducted in the Songdo International Business District, South Korea, the study utilized a multi-drone experiment covering 20 intersections, capturing approximately 12TB of 4K video data over four days. The framework produced two high-quality datasets: the Songdo Traffic dataset, comprising approximately 700,000 unique vehicle trajectories, and the Songdo Vision dataset, containing over 5,000 human-annotated images with about 300,000 vehicle instances in four classes. Comparisons with high-precision sensor data from an instrumented probe vehicle highlight the accuracy and consistency of our extraction pipeline in dense urban environments. The public release of Songdo Traffic and Songdo Vision, and the complete source code for the extraction pipeline, establishes new benchmarks in data quality, reproducibility, and scalability in traffic research. Results demonstrate the potential of integrating drone technology with advanced computer vision for precise and cost-effective urban traffic monitoring, providing valuable resources for developing intelligent transportation systems and enhancing traffic management strategies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑