arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.07667cs.CV
收藏

PLT-D3:用于立体深度与场景流的高保真动态驾驶仿真数据集

PLT-D3: A High-fidelity Dynamic Driving Simulation Dataset for Stereo Depth and Scene Flow

Pilotier;University of Waterloo(滑铁卢大学)

Joshua Tokarsky, Ibrahim Abdulhafiz, Satya Ayyalasomayajula, Mostafa Mohsen, Navya G. Rao, Adam Forbes

AI总结:

本文提出 PLT-D3 动态天气驾驶仿真数据集,基于 Unreal Engine 5 提供高分辨率立体图像及深度、场景流真值,并建立深度估计、光流和场景流基准。

摘要:

自动驾驶已取得显著进展,这得益于计算硬件的创新和复杂的深度学习方法。这些进步的基础在于数据集的可用性与质量,而数据集对于开发和改进可靠、通用的自动驾驶算法至关重要。尽管已经开发了许多数据集以支持自动驾驶感知技术的演进,但很少有数据集能够提供在各种天气条件下全面测试和增强系统鲁棒性所需的多样性。许多公开数据集缺乏对挑战性天气场景的全面覆盖,也缺乏详细的高分辨率数据,而这些对于训练和验证先进的自动驾驶感知模型至关重要。本文提出 PLT-D3,这是一个动态天气驾驶数据集,专门用于增强自动驾驶系统对不同天气条件的适应能力。PLT-D3 提供使用 Unreal Engine 5 生成的高保真立体深度和场景流真值数据。具体而言,该数据集包含同步的高分辨率立体图像序列,复现了雨、雪、雾以及多种光照条件等广泛的动态天气场景,在基于仿真的测试中提供了前所未有的真实感水平。PLT-D3 的主要目标是解决能够模拟真实世界天气变化的综合训练与测试资源稀缺的问题。研究还利用 PLT-D3 为若干关键自动驾驶任务建立了基准,例如深度估计、光流和场景流,以衡量并提升最先进模型的性能。

英文摘要:

Autonomous driving has experienced remarkable progress, bolstered by innovations in computational hardware and sophisticated deep learning methodologies. The foundation of these advancements rests on the availability and quality of datasets, which are crucial for the development and refinement of dependable and versatile autonomous driving algorithms. While numerous datasets have been developed to support the evolution of autonomous driving perception technologies, few offer the diversity required to thoroughly test and enhance system robustness under varied weather conditions. Many public datasets lack the comprehensive coverage of challenging weather scenarios and detailed, high-resolution data, which are critical for training and validating advanced autonomous-driving perception models. In this paper, we introduce PLT-D3; a Dynamic-weather Driving Dataset, designed specifically to enhance autonomous driving systems' adaptability to diverse weather conditions. PLT-D3 provides high-fidelity stereo depth and scene flow ground truth data generated using Unreal Engine 5. In particular, this dataset includes synchronized high-resolution stereo image sequences that replicate a wide array of dynamic weather scenarios including rain, snow, fog, and diverse lighting conditions, offering an unprecedented level of realism in simulation-based testing. The primary aim of PLT-D3 is to address the scarcity of comprehensive training and testing resources that can simulate real-world weather variations. Benchmarks have been established for several critical autonomous driving tasks using PLT-D3, such as depth estimation, optical flow and scene-flow to measure and enhance the performance of state-of-the-art models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑